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Chapter  I 


INTRODUCTION 


The  primary  aim  of  this  evaluation  of  Follow  Through  planned  varia- 
tion is  to  determine  whether  educational  innovators  have  been  able  to 
implement  their  programs  of  compensatory  education  in  several  diverse 
sites.     In  the  present  study,  we  examine  the  results  of  efforts  by  seven 
Follow  Through  sponsors-  to  deliver  their  models  to  36  projects.     In  this 
report,  the  degree  of  implementation  is  defined  as  the  extent  to  which  a 
sponsor  has  been  able  t     influence  teachers  in  different  sites  to  follow 
model  specifications  in  the  classroom.     Two  criteria  were  used  to  judge 
implementation:     (1)  how  similar  are  the  classrooms  to  each  other  when 
compared  on  sponsor  selected  variables?  and  (2)  how  different  are  sponsor 
classrooms  from  Non-Follow  Through  classrooms?     Implementation  is  evalu- 
ated by  observing  in  the  classrooms  and  coding  observable  events  speci- 
fied by  the  sponsors  as  critical  to  their  model. 

* 

To  make  an  educational  theory  come  ali^^e  in  the  classroom  requires 
great  effort   (see  Lucas,   1973;  Weikart  and  Banet ,  1973).     Follow  Through 
sponsors  had  a  very  short  time  in  which  to  gain  the  confidence  of  school 
officials,  parents,  and  teachers.     They  had  to  develop  training  procedures 
for  teachers  and  aides  and  they  had  to  prepare  or  select  and  sequence 
curriculum  materials.     This  report  does  not  evaluate  a  sponsor's  impact 
upon  parents  or  the  community:     it  does  evaluate  the  observable  effects 
of  the  sponsors*   influence  on  the  teachers  and  aides.     A  second  objective 
of  the  study  is  to  examine  the  relationship  of  implementation  and  class- 
room instructional  processes  to  student  performance. 

The  study  of  implementation  has  too  often  been  neglected  in  the 
evaluation  of  large-scale  social  reforms.     A  problem  in  educational  in- 
novations is  that,   in  too  many  cases,  the  programs  have  not  been  imple- 
mented,    evaluation  therefore  could  not  yield  information  about  either 
effectiveness  or  ineffectiveness  of  tiie  innovation.     Charters  and  Jones 
(1973,  p.  6)  call  the  collection  of  test  data  an  "abrogation  of  pro- 
fessional responsibility"  unless  evaluatois  also  measure,  or  at  least 


Sponsors  of  educational  models  who  were  observed  Spring  1973  were  Far 
West  Laboratory  for  Educational  Research  aid  Development,  University  of 
Arizona,   Bank  Street  College  of  Education,  University  of  Oregon, 
University  of  Kansas,  High/Scope  Educational  Research  Foundation,  and 
Education  Developiaent  Center. 


describe  differences  between  experimental  and  comparison  programs  (e.g., 
in  the  Follow  Through  program,  to  determine  whether  the  behavior  patterns 
of  teachers  and  students  are  consistent  with  the  planned  innovation).  The 
consequence  of  slighting  the  implementation  factor  is  that  "elaborately 
designed  studies  may  end  up  as  appraising  non-events,  with  no  one  the 
wiser"   (Charters  and  Jones,  p.  5).     Behind  the  Classroom  Door  (Goodlad 
et  al. ,  1970)  and  "Planned  Variation'     From  the  Perspective  of  a  Model 
Sponsor"  (Weikart,  1973)  provide  information  relevant  to  the  implementa- 
tion issue.     Goodlad's  study  indicated  that  although  teachers  and  princi- 
pals of  the  sampled  schools  assumed  that  they  had  implemented  educational 
innovations,   findings  from  observations  in  the  classroom  revealed  quite 
the  reverse — that  traditional  education  practices  generally  prevailed: 

"One  conclusion  stands  out  clearly:     ^any  of  the  changes  we 
have  believed  to  be  taking  place  in  schooling  have  not  been 
getting  into  classrooms ...  there  seems  to  be  considerable 
discrepancy  between  teachers*  perceptions  of  their  own  in- 
novative behavior  and  the  perceptions  of  observers"  (Goodlad 
et  al.  ,  1970,  pp.  97  and  98) . 

Weikart  (et  al.,  1973)  stated  that  Follow  Through  sponsors  learned 
tie  hard  way  that  there  was  "apparently  a  vast  gulf  between  the  smiles 
and  nods  of  workshop  sessions  and  actual  classroom  implementation  of  a 
model"   (Weikart,  p.   12).     Despite  "the  enthusiasm  of  the  summer  work- 
shops," Weikart  found  little  change  in  the  classrooms  a  few  months  later. 
These  findings  add  confirmation  to  Mason* s  (1973)  assertion  that  evalua- 
tion studies  frequently  find  that  the  innovation  "was  not  actually  im- 
plemented in  the  manner  specified  by  the  developer." 

Although  the  effectiveness  and  ur.ility  of  innovative  programs  for 
compensatory  education  have  come  under  serious  question  of  late  (Jencks 
et  al.,  1972,  and  Mosteller  and  Moynihan,  1972),  these  studies  only 
evaluated  the  effects  of  single  components  of  educational  systems  such 
as  library  facilities  on  science  laboratories  on  achievement  scores. 
They  did  not  evaluate  the  effects  on  achievement  of  total  educational 
programs  (such  as  those  represented  in  Follow  Through.     As  Wiley  (1973) 
has  so  aptly  stated: 

"Educators  have  spent  considerable  space  attempting  to  show  that 
[Coleman^s]  influential  study  of  the  effects  of  schooling,  the 
Equality  of  Educational  Opportunity  survey,   from  its  original 
report  to  the  most  recent  reanalyses  of  its  data,  has  been  so 
focussed  on  issues  of  the  allocation,  to  schools,  of  resources — 
such  as  teacher  training,   textbooks,  physics  laboratories,  and 
remedial  instruction — that  more  general  and  basic  sources  of 
school  effects,  such  as  quantity  of  schooling,   (and  we  might 
add  Planned  Programs  based  on  Educational  Theory]  were  neglected." 


A.  Background 


Project  Follow  Through  was  established  by  the  Congress  in  1967  (the 
legislative  authority  was  the  Economic  Opportunity  Act  of  1964,  as 
amended)  when  it  became  apparent  that  a  program  was  needed  in  the  early 
grades  of  public  school  that  was  articulated  with  Project  Head  Start 
goals  and  approaches  and  therefore  would  provide  a  comparable  educational 
program  for  economically  disadvantaged  children.     A  clearly  stated  pur- 
pose of  the  Follow  Through  program  was  the  enhancement  of  the  life  chances 
of  the  economically  deprived  child.     Deutsch   (1967)  hypothesized  that 

"because  of  prior  deprivat ion . . . the   ^disadvantaged  *  child 
comes  to  school  with  a  deficit  in  his  readiness  to  learn 
and  to  profit  from  the  academic  program,  as  measured  by 
standardized  intelligence  and  achievement  tests;  and  as 
they  continue  in  school,  this  gap  between  the  disadvantaged 
and  his  white,  middle-class  compeers  widens.     In  short,  the 
deficit  at  entry  becomes  cumulatively  greater  with  each 
successive  year." 

However,  an  evaluation  by  Wolff  and  Stein  (1966)  of  the  first  summer 
program  of  Head  Start  in  1965  had  indicated  that  the  initial  gains  of 
the  children  had  not  been  maintained  in  the  public  school.     These  early 
findings  were  believeo  to  indicate  that  a  more  sustained  program  of  longer 
duration  might  produce  lasting  gains.     The  result  was  the  establishment 
of  Follow  Through  (Although  initially  planned  as  a  service  program,  the 
limited  funds  appropriated  for  the  program  led  to  the  administrative 
decision  by  USOE  and  OEO  to  establish  Follow  Through  as  a  social  experi- 
ment.) as  a  longitudinal  quasi-experimental  program  that  would  evaluate 
the  ability  of  an  intervention  program  to  enhance  the  educational  achieve 
ment  of  economically  disadvantaged  children.     The  program  administration 
of  Project  Follow  Through  was  delegated  by  OEO  to  OE,  where  it  remains. 

Project  Follow  Through  was  originally  set  up  in  a  "planned  variation" 
research  design;  that  is,   the  goal  was  to  examine  the  differential  effect- 
iveness of  programs  based  on  divergent  educational  and  developmental 
theories.     The  program  began  when  researchers  and  other  educational  stake- 
iiolders  were  invited  by  the  government  to  submit  plans  for  establishing 
their  various  programs  in  public  schools  in  order  to  test  whether  their 
individual  approaches  could  improve  the  educational  achievement  of  eco- 
nomically disadvantaged  children.     From  the  group  that  came  forward,  22 
were  selected  to  implement  their  programs  as  Follow  Through  program 
sponsors.     Eleven  of  the  22  sponsors  had  developed  and  tried  their  edu- 
cational concepts  in  university  settings;  eight  were  affiliated  with 
private  research  institutes  and  three  were  community  developed  programs 
(see  Appendix  A) . 

The  sponsors  described  their  educational  models  to  an  audience  that 
included  representatives  from  school  districts  around  the  country  at  a 
conference  in  Kansas  City,  Kansas  in  1968.     Ultimately  sponsor  models 


were  implemented  in  154  Follow  Through  projects  within  136  urban  and 
rural  communities  located  in  all  regions  of  the  nation.     The  Follow 
Through  sponsors  then  faced  the  challenge  of  program  implementation — 
including  guiding  the  behavior  of  teachers  toward  specified  sponsor  goals. 

Upon  being  chosen  by  a  community,  the  sponsor  had  to  develop  a  co- 
operative relationship  with  the  local  school  officials,  the  parents,  and 
the  teaLhers.     He  also  needed  ro  specify  the  many  aspects  of  the  program, 
including  the  activities  that  should  occur,  the  materials  to  be  used,  the 
use  of  classroom  aides,  and  the  approaches  to  be  taken  towara  children. 
Field  staffs  had  to  be  developed  who  could  train  classroom  teachers.  Some 
of  the  sponsor's  training  staff  were  from  the  local  community  and  others 
traveled  to  the  site  from  the  sponsor's  home  location.     Most  sponsors  had 
a  two-week  summer  training  session  for  teachers  and  aides,  followed  by 
weekly,  semi-monthly,  or  tnonthly  inservice  training  and  supervision  of 
the  teachers. 

It  was  recognized  early  in  the  Follow  Through  program  that  changing 
teacher  behavior  with  a  resultant  change  in  children's  behavior  and  test 
scores  would  take  a  long  time.     Thus,  it  was  decided  that  the  sponsors 
should  have  a  five-year  period  in  which  to  try  to  implement  their  models 
in  the  communities. 

In  earlier  evaluations  of  Follow  Through >  the  major  emphasis  was 
to  determine  child  outcome  in  terms  of  child  performance.    Yet  it  was 
clear  that  if  such  an  effect  was  found,  and  if  the  effects  were  different 
from  one  model  to  another,  we  would  not  know  what  caused  the  differences. 
Thereiore,  we  needed  to  know  what  was  actually  happening  in  the  class- 
rooms.    In  order  to  determine  whether  the  sponsors  were  effective  in 
getting  teachers  to  practice  their  methods  in  the  classroom,  it  was 
necessary  to  observe  the  classrooms  systematically.    We  wanted  to  know 
whether  a  child's  day  in  the  classroom  corresponded  with  the  sponsor's 
educational  prescriptions.     It  was  evident  that  an  observation  instrument 
of  process  variables  was  needed  because: 

-  Systematic  observation  is  the  only  means  to  document  some 
phenomena,  particularly  certain  behavioral  phenomena. 

-  Systematic  observation  is  a  way  to  obtain  an  objective 
description  of  treatments. 

-  Systematic  observation  is  a  basis  for  judging  the  extent 
to  which  the  intended  treatment  is  actually  present. 

-  Observation  can  be  used  as  an  alternative  to  more  traditional 
methods  for  assessing  child  growth  and  development. 


Egbert  (1973)  provides  a  historical  view  of  Follow  Through. 
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Chapter  11 

::?ATA  COLLECT  !o:; 


T.^  plar.  for  the  Spring  1973  clcsiircor:  o''"^*^rvation  data  collection 
'^:ls  t^^^z.  on  ciscussions  ai^ng  Follow  Thrcup;h  sponsor  repre:-ent3- 
'i£*r^  ^".i  =5<^:^3rs  of  TSOE  and  SRJ.    The  principal  consideration 

1       Cnrt4znu-!L^c  th^  desigr,  of  tLe  data  collection  effort  was  the  neces- 
-t  '  fcr  pr??vldiii^  information  regarcin;^  the  inpler^ntation  of  the  Fol- 
;  *  r:.rc;:rh  sponsored  z^<vls  (sec  Chapter  I,  p.  1,  for  definitions  of 
;-iL^.=^:iticni-     In  order  to  evaluate  a  sponsor's  ability  to  inpleisent 
i    -^-^il  It,  several  diverse  5:tc-s,  approxinately  four  first  and  four 
t  -r;  ^rac-f  rla^sroras  in  five  fr-i-is  per  sponsor  were  i  »iected  for  ob- 
T^.*:  jn^icsr  zi  this  :>asriing  schtrr^  vas  based  on  an  analysis 
f^r  ^la^ni'g  r^^rpo^^^rs  thac  indicated  that  gross  differences 
J  cn  tct-3l  i-tr  !-e^-;-ntstIon  scores  ccald  be  detected,  vith  a 
r^l^tfv^^Iv  i*r^ree  of  confidence,  tender  this  scheee. 

^ri^^^rv  -cnsidtrr^^tion  in  tte  sel^'i  ticn  of  the  sanple  vas  the  occur- 
r^c^        ti^^tin^  in  the  Spring  of  1973,  since  investigation  of  the  re- 
Lit ---^^-^  tctvi.-trn  teaching  pro«dures  arc^  ^:hild  test  outcoi^s  required 
ir^i  t:^^r^        t-f^t  scores  for  th-.-  children  in  the  sarnie. 

i^t^  us-:  i:  in  tnis  report  inclt^de  observations  focused  on 
tviT^-nx  r-tr&^c%:n^I         individual  children,  cIa*^^reor  roster  data, 
:  ^i^^t  '        r^s^its.  3^^i  t^rs^rer  am:  t^jacher  ^ide  survc-v  result?^  (see 


.-'^  -thapt'-r  contains  ^  ^scrij^tior.  of  the  ^selection  process  o:  the 
s=t.-^,  t!^ssro^^:^,  an^I      -Icren,  as  veil  as  infomation  about  the 
&c  mtcrins  characteristics  of  the  children.     It  a3*io  de- 

^-ir^i-r--  t:.^-  Clai=src^:^  v^-^cr/^t i"  Instr,^nt  ^X"  I)  and  th<.-  proc*/diir^s 

in  c^Il^-t^-i^  th^  st^^cT  Th+-  COI  and  the  procedures  used  in 

t"^^  r^ll^-  71;r>*^h  ,l4i^ssr^«^  ob^^r^'^^tion  ^tucy  *tre  slightly  nodi-* 

^-^c  f^r  Spring  Ir'^  st^v. 


i=>  '     t  >      r :   SJ  t     ,  ^  "  =^  s  ^  rc  cri3 ,       ^  ^  -  c  us  Adults  and  Child  r  en 
K^tion^I^  for  S^-iecti^.  c:  Sites 

prln^rv  ^rcn^  i c^r^t icn^  fcr  sel^^ctin?  ^^-te*?  were: 
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-  That  they  were  among  the  sites  where  pupil  testing 
was  to  occur  in  Spring  1973  as  part  of  the  Follow 
Through  evaluation; 

-  That  each  sponsor  would  then  have  a  more  balanced 
geographic  distribution  of  sites,  which  included 
urban-rural  and  north-south  projects; 

-  That  each  sponsor  would  have  at  least  two  sites  which 
he  considered  well  implemented. 

An  attempt  was  made  to  select  sites  that  previously  had 
been  observed  so  as  to  extend  the  longitudinal  data  base  for  possible 
future  observation  studies. 

Seven  sponsors  were  selected  for  the  study  because  xhey 
each  had  at  least  five  sites  that  met  the  criteria.     Six  sponsors  had 
five  sites  included  in  the  study  sample  and  l^niversity  of  Arizona  had 
six  sites,  making  ^  total  sample  of  36  sites.     Within  each  Follow  Through 
site,  a  sample  of  up  to  four  firsn  grade  and  up  to  four  third  grade  class- 
rooms were  selected  for  observation,  making  a  total  of  136  first  grade  and 
135  (Table  2)  third  grade  classrooms  observed.     In  each  classroom,  four 
children  as  well  as  the  adults  were  observed.     Table  2  lists  the  selected 
sites  by  spOiisor  and  the  number  of  classrooms  observed  by  grade  level. 
In  addition,  one  Non-Follow  Through  classroom  each  at  the  first  and  third 
grade  levels  in  each  of  the  36  sites  (a  total  of  72  classrooms)  were 
scheduled  to  be  observed  as  comparison  classrooms. 

Locating  adequate  comparison  groups  is  always  a  problem  for 
large  scale  field  studies.     With  assistance  from  a  panel  of  educational 
researchers'^  SRI  staff  made  a  decision  to  pool  the  scores  of  Non-Foilow 
llirough  classrooms  over  all  sites  as  the  standard  of  comparison  rather 
than  having  a  separate  onsite  comparison  for  each  site.     Some  panelists 
suggested  that  a  set  of  comparison  classes  for  each  Follow  Through  site 
be  provided  so  that  similar  site  characteristics  would  be  assured.  How- 
ever,  this  alternative  presented  several  problems:     (1)  The  total  number 
of  Non-Follow  Through  classrooms  was  not  adequate  if  they  were  divided 
by  region  or  by  urban/rural  characteristics,   (2)  the  relative  unavail- 
ability of  baseline  test  data  due  to  interschool  dispersion  of  comparison 
group  children  subsequent  to  the  kindergarten  or  entering-f irst  grade 
year,  and  (3)  if  the  comparison  were  drawn  from  a  set  of  Non-Follow  Through 
and  Follow  Through  classrooms,   there  was  the  problem  of  overlap  in  imple- 
mentation processes  if  Follow  Through  classes  of  other  sponsors  were  in- 
cluded in  the  pool  of  potential  matches  based  on  demographic  character- 
istics.    A  common  Non-Foilow  Through  group,  on  the  other  hand,  has  the 


The  panelists  included:     Eugene  Tucker,   Louise  Eckerson,  and  David 
Iwamoto  of  OK;  Robert  Linn,  University  of  Illinois;  Andrew  Porter  of 
NIE;  Jane  David  of  H-iron  Institute;  and  Richard  Brandt  of  University 
of  Virginia . 
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(lASSRHOM  i^BSiKVAflOv  S;\MPn  ,  SPRING  1973 


Sponsor  aiui  J>^i^  o_s_ 


Far  West  Laboratory  for  Lducat lonal 
RM>_  _  _^  

OJOl  Berkeley,  ^.ai  1  f  .'^ 

0204  Duhich,  Minn.  ^ 

0207  Lebanon,  N.H. 

0209  Salt  Lake  City,  I'tah 

02 13  Tacoru,  Wash. 


Number  of  Follow  Through 

C 1 a s  s  e  s  Ob  s e  r  v ed  

F'lrst  Grade  Third  Grade 


L  U 

4  4 


University  of  Ar  i_zona 

03O5  Des  Molpes,  Iowa 

0307  Fort  Worth,  Texas'^ 

0308  LaFayette,  Ga. 

0309  Lakewood,  N.J. 
0311  Newark,  N.J. 
0316  I  incoln,  Nebraska 


Bank  Street  College 

05O2    Brat t leboro,  Vernon t 
Fall  River,  Mass. 
New  York  Citv,  P.S.  243K 


0504 
0506 
0508 
0510 


Philadelphia  II,  Pa.' 
Tuskegee,  Ala.^ 


University  of  Oregon 

E.  St .  Louis ,  111 . 


0703 
0707 
0708 
0711 
0719 


New*York  City,  P.S.   1 37K 
Racine,  Wise. 
Tupelo,  Miss.* 
Providence,  R.I. 


4 
3 
4 
4 
4 


yj\i-ypxsity  of  Kansas 

0801  New  York  City,  P.S.  7  7X* 

0803  Philadelphia  VI,  Pa.'^' 

0804  Portageville  ,  Mo  . 

0806  Kansas  City,  Mo. 

0807  Louisville,  Ky. 


2 
4 
3 
4 
4 


High  Scope  Educational  Research 

Found  at  ion  

0901  Greenwood,  Miss.* 

0902  Ft.  Walton  Beach,  Fla.* 

0903  New  York  City,  P.S.  92M 

0906  Greeley,  Colo. 

0907  Denver,  Colo. 


4 
4 
3 
3 
4 


Ed u c at  i o n  Pevelopment  C;?nter 

1 101  Burl ington,  Vermont 

1103  Philadelphia  IV,  Pa.' 

1106  Paterson,  N'.J.* 

1107  Rosebud,  Texas 

1108  SmiChfield,  N.C. 

Total 


4 
4 
3 
_4 

136 


4 
4 
4 
3 

_2 

135 


These  sites  havt;  been  observed  previously. 
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advantage  of  providing  a  constant  measuring  tool  chat  doe  not  vary  across 
sponsors  or  sites.     On  the  basis  of  this  discussion,  the  conclusion  reached 
was  that  pogled  Non-Follow  Through  classrooms  would  be  used  for  purposes  of 
comparison. " 

The  pooled  Non-Follow  Through  offers  a  reasonable  match  on 
demographic  characteristics  for  many  sites,  but  as  shown  later  (Tables 
3  and  4  on  pages  14  and  15)  this  technique  does  not  provide  a  good  compari- 
son for  such  sites  as  Fort  Walton  Beach  (0902)''''''  where  the  mean  baseline 

score  for  first  grade  children  is  13  points  lower  than  the  mean 
score  for  pooled  Non-Follow  Thrc igh  children,  or  for  Lebanon  (0207)  where 
the  mean  for  the  black  population  is  zero  compared  to  a  mean  of  48%  for 
pooled  Non-Follow  Through.     Given  the  deficiencies  of  the  available  com- 
parisons, the  pooling  procedure  seems  the  best  of  the  two  choices.  Ap- 
pendix B  provides  discussion  of  the  effect  of  demographic  characteristics 
on  classroom  control  systems  and  the  positive  or  negative  affect  displayed 
in  the  classrooms.     This  discussion  indicates  that  the  effect  of  entering 
child  characteristics   (baseline  WRAT,  race,  sex,  bi-lingual  language, 
whether  or  not  the  child  had  preschool)  on  observed  classroom  processes 
Is  slight.     For  the  purpose  of  this  implementation  report  (since  child 
demographic  characteristics  apparently  do  not  affect  process  data),  we 
conclude  that  pooled  Non-Follow  Through  classrooms  form  an  acceptable 
comparison  group  for  Follow  Through  classrooms  even  though  demographic 
characteristics  are  not  matched. 

The  decision  to  conduct  observations  at  two  grade  levels 
was  based  upon  the  rationale  that  one  grade  level  alone  would  not  permit 
a  valid  generalization  about  the  degree  of  model  Implementation.     It  was 
felt  that  for  developmental  reasons  implementation  at  the  flr.-t  grade 
would  probably  be  different  from  implementation  at  the  third  grade. 
First  grade  curriculum  often  focuses  upon  developing  basic  skills  while 
third  grade  curriculum  focuses  upon  using  basic  skills.     Reasons  for 
choosing  the  first  and  third  grades  rather  than  kindergarten  and  second 
grade  were: 

-    It  was  Important  to  see  how  reading  and  math  are 
taught  in  the  first  grade  since,  in  so  many  cases, 
reading  and  math  scores  are  used  as  the  basis  for 
judging  school  success.     Thus,  how  these  basic  skills 
are  taught  at  the  lower  level  is  of  interest  to  the 
study. 


Other  evaluations  of  Head  Start  and  P'ollow  Through  have  also  used  a 
pooled  Non-Follow  Through  comparison  (Smith,  1973;  Stearns,  1973;  and 
Sta] lings,  1973). 

See  Appendix  A  for  a  listing  of  sites  by  sponsor  and  code. 


13 


ERLC 


^•^   O  vf 


^ 


<\i  n     ■*  o 

CC  «  QC  O  <L 


'  O  O  O  ■*  O      Oo4337><*1(\<       ^  O  OJ  O  3  O 


•  f\<  C>  >J  •# 


0^00 

fn o  D 


*  O  O  »  'N*  O 


-  O  '•^  O  O  3 


•*  ^  ru  a>  3  o 


O     ^-  M  o 


■  *  c  K  a 


a  if  O'  A.  I 


cor-  n  c  fV  r"     Ofn  , 


fv  o  r«-      ^  — 


^  o 


^c^f-^r*    ^oc^ootT  o^tr^cv"^ 


*  r>  ru  o  »r>  o 


.    — »  fu 


>•.>    »>*  _f»>  » 

;      ct         In—  c 


;f>  IP     «  m  ru 


o  a>  fxi  »i 


flC  ^  OD  <£ 


oc  33     n  o  .0    inomorum    tr,J\  oj  CO  o  o    kTiOron^o     ,^o*        o  r» 


•      O  flO  GC  IP 


^<Z>  M  ^  <^  05 

^  (\j  fu  r>  ^  ^ 


^  3  a  w  O 

■  J3  ^ 

>  0,  3  V   •«  »9 

i  ifl  a  -J  wi  ^- 

'  ^  <^ 


O  1  '3 

b.  >J  >J 

u->       CO  c 

■  w  2  < 


U  0 

>  c 


<t  O  O  O  C'  o 


000000 


>  b.  v:  Pk.  H 


^  o  < 


5  OC  O 

>  o  o 


u.  o  O  O  " 


?  o  

^  >•  X   O  («  o 

^  >:  Pk,  a,  M  ^ 

,    -i  ^  sO  »^ 

U.  O  o  O  O  O 

O  flO  00  CO  00  CO 

00000 


4/>  C>  Z  O  a 

^  ^  M  v3 

T  O  O  O  O  O 

O  o<  a  a>  <T 

-«  o  o  c  00 
X 


»  3  ^ 
.1  V 


i  a,  a.  u.  tn 


ERIC 


14 


^  o  o 


•  ^      o  o 


.T'  o  3  — ' 
X  u"-  ^  % 


o  go  <^  <y  '-< 


.  o  o  o  >  CL 


5  -D  «C  IT  iT  O 


oO  X  o  o 


f^O  o  t-  ♦ 


^ooiTo-n     »riOf\jrfi/»h-*-    CTvO*»>o     /s^o-nooo     ^^.#300    «o  o-0'n'>j  r^o»0-#o 


"OO'V'N/M       '«0  O  < 


-TO  "1        O  O 


i  3  O  O  : 


t>  C  1 


^  O       O  3  3 


'  -J  ^  o       o  3  -n  -  r 


o  tT)  r\j  o  ^ 


tr  IT  <r 


go  IT  IT  f*"  C  T 


xo<-irf^t^     **<(v^<»ic^    3^f^(v<\<o^  '^•♦iT^'^'* 


*J  o 

c  o 


_  o     1*  cr  < 


oo**.  c  c  c 


< 

0 

v3t/>  OD  0  tp  ru  »n 

•C  IT 

(^(Vi  ^-      —  * 

-a  *  ir 

ru 

r» 

-J  -< 

—  er 

0 

2: 

^'  ^      M  « 

ruru 

—  ru 

'"'^         r«  (V/ 

<N  ^  ^ 

i/> « 

« 

n 

^  rvj  0  h- 

'-•  •« 

>c 

c^vn  =>  * 

f^r*  •** 

00  > 

vT 

n 

M  (VI 

0^  n  ^      f\j  ^ 

0 

00  0  ^^  p^  «  (^ 

00  ift 

ru 

■#  0  * 

<o 

0  ru 

< 

©  (^ 

rv, 

r>  ♦      IT  r> 

«  K 

0  r>  fn  0  ^ 

\r>  0 

2; 

■#  rg 

-#  ■# 

n  ji  n  n  ^  rvi 

•«  « 

m  rvj 

in 

"^7ri 

o  ^- 

00  M  «M  « 


Iff  t\>  AJ     "^<\*  «£> 


A*  'V*  ^ 


"-^  ♦  »  ^  'n 


r-     '-'^  ^  ^       h,      fM^  9'  ^  t>  tt 

~      rv)     (V  ru  <~c     f^ru     ru  fxj 


O  »  M  »> 
-1     n  tP  ® 


1  o  «  ( 
-  ru  — 


f^O<CS<CO      ^M^^OD*-!  ■w  m 

<#  •#  fi  D     soiT*  o     <o  *  ^  r\j<>  cx>  7  o 


ru  <-  '\J     '^.->  ru  rg 


-g     -T  ii  M  >  -g  ^ 

—I     "^ru  ru  rg  ry  . 


D  ^  M  (^  *  (Vi 


O  «  i> 

■*>r^  m  <n  (f* 


_^r^r^r^f\,(C  ^oi/>««r^<£  ^(ViM(y'-«o  ^f^-*r^ryift  g^co  ■•^'O'lr  ^<V(^*-•rJ  (gruoarcC'* 

«o>0'^f^'#  ooo«©f^r»  o'^»'''^'^'~  ^et*-<inr>ir  (N^irn<»io»^  o'^'^'^»*-r^ 

'>^rv)ii«iDirv'«  vor«"r>"»/>*mr«.  c;?r^im-*ir  '^*(\J#■«(^  C?*—  -•'£ir<\<  ^wncMf-io  ^'-<f\j«\.o^ 

^ooooo  '^oooooo  2^0^^^  2^^^^^  2^^^^^  ^00000 

^^•♦ircy—  o^»f<fv.ifr"ir  /M«irciro  ^-foascr  ^^.-r-csr*-  ^erO'fVjrc  ^f^.cctf^.'r\ 

/^oor^(\jirv  cjv'-'fuffo*^*  *^tn(rvof*o  o-f^o-^Mir*  ^^^^ko^-^  .ii«or\jec— •'^  r^(vinir<^— • 

^  oj  fvi  <\j  ^  ^        ^  ^  i/>  ri     f\j  ^^^»>o»-<n  -J  f\j  ^     ^  ^  f\j  n  rvj  (\)  nj 

ooirttnco       o  tf»  o  u%     o  o  o     o  .  o  o  o    in  f^oirooo  -ooor^in  ir  o  k  o 

o  1/^  M  rv.  iT  i/-  r«wCr^»nr>"i^o  vor^oinr^-d  oc^  o  c  ^orvcotn  rjin  i/^  c  rn  rvj  ^^-^^e^Olr 

'^»n»n»-"*»  '^fV)«~'f^#^-<  ♦  o  ^  a  ^i^arvi  Oo^ooo  f^/>»-<v^<oc^  ^OMf^ry^jn 

'^rur«(viru-<  ^ru(virurv,(\ifu  cv.r\jr>M  '^M'nfu  —  M  '^n  jnnjnru  <^ruMn«\<ru  '^Mrurynrvj 


*  »^  *  *  -(f 


ru    <n  ^  ^ 


^     n  ru 


'*■>      ?  V  -9 

»J  X  Q  -J  VT)  ^ 


<  00000 


*^        *J  0  * 

*-*  »  u  U. 

rtr    ^  0  1  < 

a  u.  ^  ^ 

fcA  CO  » 

U.  O  O  O  O  ■« 

o  o  o  o  < 


(  >  w  - 
1  «  ft-'  - 


it  o  < 

Z.  i/^  " 

<  o  < 


>  00  o 

>  o 

>  o  o 


Of    •  ^ 

c  -J  £  oc  I 


^000- 
o  o  o  < 


te  «  >  .  ^  a  ^  a. 

t  <fl  «  UJ  c  <s 

u  M  ^  a  o  :x  • 

ki  C  3  O  V  U 


pL.  ft. 


>  00  OS  CO  CO  00 

00000 


Coo 
io  o 


■>-<  « 


>  o  o 

>  o  o 


>  3  »M 

■•  X  i: 

;  (I  w 

^  ^    ^  V)  ^ 

3  jC   4  O  ti 

M  ft,  CO  o:  v> 


^     »o  r-  00 
00000  I 
J  ^  ^  ^  ^  ^  Z 


15 


ERIC 


Since  the  third  grade  classes  were  terminating  Follow 
Through  and  were  being  tested,  and  since  the  primary 
concern  of  the  total  Follow  Through  evaluation  was  to 
determine  the  program's  effect  on  these  children, 
clearly  the  third  grade  classes  should  be  observed. 

The  decision  to  observe  four  children  per  classroom  was 
made  at  a  time  when  we  were  planning  to  relate  classroom  procc;*:s  to  out- 
come scores,  using  the  child  as  the  unit  of  analysis  and  using  child 
focus  data.     For  such  an  analysis,  the  decision  was  made  to  use  four 
children  per  classroom  and  obtain  five  Five-Minute  Observations  (FMO's) 
per  child  in  an  effort  to  obtain  a  more  stable  estimate  of  each  child's 
behavior.     This  approach  was  subsequently  dropped  in  favor  of  using  the 
classroom  as  the  unit  of  analysis. 

The  selected  COI  sample  allowed  for  maximum  overlap  with 
the  Spring  1973  pupil  test  sample.     Such  an  overlap  was  essential  in 
order  to  examine  the  relationship  of  classroom  process  and  pupil  out- 
come.    Thus,  students  in  34  of  the  36  observation  sample  sites  were 
tested.     The  two  exceptions  \'ere  Fort  Worth,  Texas,  and  LaFayette, 
Georgia,  both  of  which  were  University  of  Arizona  sponsored  sites. 
These  two  sites  were  chosen  in  order  to  provide  continuity  with  observa- 
tions conducted  in  earlier  years;  to  provide  better  geographic  balance 
in  the  observation  sample;  and  to  provide  part  of  the  statistical  base 
for  examining  the  question  of  exportability  of  the  University  of  Arizona 
model. 


b.      Criteria  for  Identifying  Classrooms  and  Children 

The  primary  consideration  in  identifying  the  classrooms  and 
the  children  to  be  observed  was  the  availability  of  baseline  data.  The 
baseline  data  consisted  of  test  and/or  parent  interview  data  collected 
on  children  in  the  fa]l  at  the  entering  grade  level,     Tn  those  cases  where 
parent  interview  data  were  not  available,  test  data  alone  were  accepted 
as  meeting  the  baseline  data  criteria. 

Baseline  test  data  were  not,  however,  available  in  every 
project  for  children  in  both  the  first  and  third  grade  classrooms-  As 
shown  in  Table  1,  while  there  were  baseline  data  for  25  first  grades  and 
25  third  grades,   there  was  overlap  in  only  16  of  the  36  projects.  The 
percent  of  children  at  each  site  with  baseline  data  appears  in  the  second 
to  last  column  on  Tables  3  and  4,     In  projects  where  baseline  WRAT  data 
are  available,  the  percentage  of  children  for  whom  WRAT  scores  are  avail- 
able is  an  approximate  indicator  of  the  proportion  of  children  within  the 
observed  classrooms  who  had  been  enrolled  in  Fellow  Through  since  their 
entry  into  school  as  kindergartners  or  entering-f irst  graders.     As  may  be 
seen  by  comparing  Tables  3  and  4,  the  proportion  of  such  children  was 
generally  greater  in  the  first  grade. 
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In  those  projects  where  baseline  data  were  not  available 
for  a  specific  grade  level,  the  Follow  Through  classrooms  were  nominated 
by  the  sponsor  and  the  Non-Follow  Through  classrooms  were  selected  by 
the  SRI  Field  Operations  staff..    The  children  selected  for  individual 
child  observations  in  those  classrooms  were  chosen  on  a  random  basis 
from  classroom  roster  lists  by    RI  staff. 


1)      Classroom  and  Activity/Adult  Selection — In  the  selec- 
tion of  classrooms,   the  ideal  situation  was  one  in  which  baseline  data 
were  available  for  all  the  children.     However,  as  it  has  away  of  doing, 
reality  interfered:     there  were  classrooms  that  met  the  ideal  and  some 
that  fell  short.     In  order  to  have  a  sufficient  number  of  classrooms  in 
the  study  sample  for  each  site,  some  adjustments  were  necessary*  For 
both  Follow  Through  and  Non-Follow  Through  classrooms  in  which  there 
were  baseline  data  on  the  children,  selection  was  made  as  follows: 

First  priority  was  given  to  classrooms  having  the 
largest  number  of  children  for  whom  both  parent 
interview  and  test  data  were  available  at  enter-- 
ing  grade  level. 

Second  priority  was  given  to  classrooms  having  the 
largest  number  of  children  for  whom  test  data  were 
available. 

For  those  Follow  Through  and  Non-Follow  Through  class- 
rooms lacking  baseline  data,  selection  was  made  as  follows: 

The  Follow  Through  classes  were  chosen  by  the 
sponsors • 

The  local  Follow  Through  Director  nominated 
Lumparison  classrooniG  at  each  grade  level  con- 
sisting of  children  of  comparable  socio-economic 
background  as  Follow  Through  children.     The  most 
comparable  classroom  was  selected  by  SRi's  Field 
Operations  staff  for  observation  and  another 
classroom  served  as  an  alternaLe. 

The  selection  of  a  classroom  automatica] ly  "selects" 
its  teacher,  aide,  and/or  volunteer  to  be  observed  while  she  is  engaged 
in  specified  classroom  activities  during  the  two  observation  days.'^ 


See  page  37  for  more  detailed  explanation  of  the  adult/ac tivity  ob- 
servation. 
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2)      Selection  of  Children — In  order  to  provide  the  neces- 
sary sample  of  four  children  to  be  observed,  a  sample  of  eight  children 
per  classroom  was  drawn  at  SRI.     The  larger  sample  ensured  that  four 
children  would  be  present  in  the  jvent  that  illness  or  other  factors 
caused  a  child  or  children  to  be  absent  on  the  observation  day.  The 
criteria  for  selecting  the  eight  children  were  as  follows: 

-  Priority  1  children  were  those  for  whom  there  was 
a  complete  baseline  data  history.''^ 

Priority  2  children  were  those  for  whom  there  was 
a  partial  baseline  data  history. 

-  Priority  3  children  were  those  with  no  data  his- 
tory but  who  had  been  in  Follow  Through  for  the 
longest  period  of  time. 

Priority  4  children  were  randomly  selected  chil^ 
dren  who  met  none  of  the  above  criteria. 

In  classrooms  where  baseline  data  were  available, 
within  the  Priority  1  category  the  eight  children  .oeiected  were  assigned 
a  position  of  1  to  8  on  a  random  basis — then  the  5,aine  procedure  was  used 
in  Priority  2,  3,  and  4  to  complete  the  list  of  eight  children.  Of 
course  Priorities  2,  3,  or  4  were  used  only  in  Lhose  cases  where  there 
were  not  enough  children  in  the  preceding  categories  to  complete  the 
list  of  eight  children. 

In  classrooms  where  baseline  data  were  not  available, 
the  eight  children  were  selected  randomly  from  the  classroom  roster  or 
class  list**  and  listed  in  the  order  in  which  they  were  selected.  The 
final  ordering  of  children  was  made  alternately  by  sex;  i,e.,  if  the 
first  child  selected  was  a  girl,  the  next  would  be  a  boy,  then  a  girl, 
until  there  were  eight  children  on  an  "Individual  Child  List."  However, 
children  with  the  most  complete  data  histories  were  the  first  priority, 
and  a  child  would  be  chosen  on  the  basis  of  the  data  history  rather  than 
sex.     The  child  identification  (l.D.)  numbers,  as  listed  on  the  Individ- 
ual Child  List,  also  are  used  to  identify  the  children  on  the  classroom 
rosters  and  in  the  data  bank. 


Tables  3  and  4  present  the  percent  of  children  at  each  site  who  have 
baseline  test  data. 

class  list  consists  of  updated  roster  information  collected  in  Fall 
1972  on  all  Follow  Through  children.     The  classroom  roster  provides 
a  demographic  description  of  the  classroom  and  serves  as  a  control 
for  subsequent  testing  and  data  processing  activities.  Classrooms 
which  were  not  rostered  in  Fall  1972  were  rostered  in  January  1973. 
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2.      Demographic  and  Entering  Characteristics 


In  order  to  evaluate  the  effect  of  a  classroom  process  or  a 
program,  it  is  necessary  to  examine  the  uniformity  of  classroom  proce- 
dures^^ and  also  to  take  account  of  differences  in  the  characteristics 
of  the  site  and  of  the  children  in  the  sample.     Inevitably  there  are 
gross  differences  in  child  and  site  characteristics  since  each  sponsor 
has  attempted  to  implement  his  educational  model  in  several  regions  of 
the  country  and  in  diverse  communities. 

The  Follow  Through  program  is  designed  to  meet  the  needs  of 
children  from  low-income  families.     A  principal  objective  of  the  program 
is  to  sustain  and  supplement  in  the  early  grades  the  gains  made  by  chil- 
dren who  have  had  a  full  year's  experience  in  a  Head  Start  or  comparable 
preschool  program. '^'^^    These  criteria  generally  determine  which  children 
participate  in  the  Follow  Through  program  in  a  particular  site.  Note, 
however,  that  within  individual  sites,  and  across  sites  nationally,  the 
Follow  Through  child  sample  is  not  controlled.     As  a  result  inter^site 
differences  exist  in  basic  child  characteristics  such  as  entering 
ability,  preschool  experience  and  language  spoken  in  the  home.  Such 
differences  also  exist  between  Follow  Through  sample  groups  and  groups 
of  Non-Follow  Through  comparison  children. 


In  order  to  measure  the  extent  and  type  of  differences  in  en- 
tering characteristics,  comparability  assessments  were  made  of  (1)  all 
Follow  Througli  sites,  and   (2)  pooled  Non-Follow  Through  classrooms. 
Most  of  the  selected  demographic  and  entering  characteristics  are  derived 
from  data  found  on  the  Classroom  Rosters  vhich  describe  the  271  Follow 
Through  classrooms  and  the  71  Non-Follow  Through  classrooms  in  the  ob- 
servation sample.***    The  data  were  collected  in  Fall  1972,  and  represent 
classroom  and  child  characteristics.     Means  and  standard  deviations  based 
on  data  from  the  four  classrooms  for  each  grade  were  computed  for  each 
site.     The  classroom  was  the  unit  of  analysis.     Tables  3  and  4  present 
the  summary  statistics  of  first  and  third  grades  for  the  size  of  class, 
average  age,  months  in  Follow  Through  as  of  Fall  1972,  percent  with  pre- 
school experience,  percent  of  black  students,   percent  of  students  with 


^Uniformity  of  the  data  collected  is  studied  in  Chapter  IV. 

**Follow  Through  Program  Guidelines,  dated  February  24,  1969  (draft) 
require  that  at  least  half  of  the  children  in  each  Follow  Through 
project  must  be  graduates  of  a  full-year  Head  Start  or  comparable 
preschool  program. 

***The  information  for  one  Non-Follow  Through  classroom  in  the  sample 
was  lost  in  the  mail. 
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ihe  Classruuni  Observation  Procedure  (COP),  which  consists  of 
three  parts:     the  Classroom  Check  List  (^^CL) ,  Five-Minute  Ob- 
s^-rvation  Pre.iiablu  (PRE),  and  Five-Minute  Observation  (HIO) . 

In  a  sin^;it'  observation  day,  the  CSl  and  tlie  PEI  are  completed  once  and 
the-  COP  (wiiich  inciaaes  the  OCL,  t'ne  PRE  and  the  FMO)  is  completed  four 
ti*T.vS  an  hour. 


1.  Class roon  Sunnary  In format ion  (CSX) 

The  Classroom  Summary  Information  section  is  designed  to  allow 
for  the  coding  of  the  number  of  children  enrolled  and  the  number  present 

the  observation  day;   [2)  the  number  of  teachers  and  aides  ass.gned 
tu  the  classroom;  and  (3)  the  number  of  volunteers  or  visitors  present 
on  the  observation  day.    Also  recorded  in  this  section  is  the  leigth  of 
Che  school  day. 

2.  Piiysical  Environment  Information  (PEI) 

The  Physical  Environment  Information  section  provides  space 
for  coding  inforriation  about  the  classroom  setting,  which  includes  the 
presence  and  use  of  specific  equipment,  instructional  materials,  games, 
coys,  and  displays  in  the  classroom.    The  observer  also  records  whether 
the  claiisroon  has  novable  tables  and  chairs  and/or  stationary  desks  in 
rows,  vhether  seating  is  assigned  during  part  of  the  day  and/or  self- 
selected,  and  whether  children  are  assigned  to  groups  by  the  teacher  or 
aid*f  and/or  select  their  own  work  groups. 

3.  Classroom  observation  Procedure  (COP) 

T]ie  CuP  consists  of  three  sections  of  codes  that  describe  the 
'jlassroor  structure  and  process: 

-  Classroom  Check  Lis-t  (CCL) 

-  Five-Minutc'  Observation  Preamble  (PRE) 

-  F 1  Vi.'-^tinute  Observation  (P!0) 


T-a:  classroom  observer  conpl-tes  the  entire  COP — the  CCL,  the  PRE,  and 

P'  5 — irproxinately  four  tines  an  lOur  or  16  to  20  complete  COPs  over 
4         Li-ur  obstL-rvation  dav.« 


ihe  r,*x^*jT  of  obscr'-ations  cannot  be  fixed  because  some  hours  are  in- 
t-  rr^rtcj        re--vi>s*.'S  or  other  out-of-c  lass  room  events. 


a. 


Classroom  Check  List  (CCL) 


As  noted  above,  the  Classroom  Check  List  (CCL)  is  com- 
pleted approximately  four  times  an  hour.     The  CCL  is  referred  to  as 
"snapshot"  of  the  classroom  because  it  allows  for  coding  relatively 
stable  "pictures,"  at  a  given  point  in  time,  of  the  activities  engaged 
in  and  the  distribution  of  the  adults  and  children  in  the  classroom. 
A  record  is  made  of  activities  occurring,  of  child  and  adult  grouping 
patterns,  of  adult  roles,  of  child  involvement,  and  of  the  materials 
used  in  the  academic  activities  (see  Figure  1).     For  example,  several 
activities  may  be  taking  place  simultaneously  in  the  classroom:     a  small 
group  of  children  may  be  doing  crafts  under  the  guidance  of  a  teacher 
aide,   the  teacher  may  be  Instructing  a  large  group  (over  8  children)  in 
reading,  three  children  may  be  working  independently  on  a  science  proj- 
ect, and  four  children  may  be  using  trucks  and  blocks  in  independent 
play.     In  this  case,  all  of  these  activities  and  the  individuals  involved 
in  each  would  be  recorded  on  the  CCL. 


b.      The  Five-Minute  Observation  Preamble  (PRE) 

The  FMO  preainble  is  designed  to  record  information  about 
the  activity  that  the  preselected  focus  person — ^whether  child  or  adults- 
is  actually  engaged  in  (see  Figure  2).    This  is  done  four  times  an  hour. 
The  observer  focuses  on  the  selected  person  just  before  the  five  consec- 
utive minutes  of  observation  begins  and  records:    whether  the  focus  per- 
son is  an  adult  or  child  and  his/her  identification  number;   the  CCL  code 
number  for  the  activity  engaged  in;  the  role  of  the  adult — that  is, 
whether  the  teacher,  aide,  or  volunteer  is  observing,  participating,  or 
directing  the  activity,  or  not  involved;   the  number  of  children  involved; 
whether  the  activity  in  progress  is  a  continuation  of  the  previously  ob- 
served activity  (i.e.,  the  preceding  FMO);  and  the  time  the  FMO  was 
started.     If,  during  the  5-minute  observation  period,  there  is  a  change 
in  the  activity  in  which  the  focus  person  is  engaged,  the  observer  re- 
cords the  activity  actually  taking  place  at  the  end  of  the  time  period 
in  the  designated  space  at  the  end  of  the  FMO. 


c.      The  Five-Minute  Observation  (FMO) 

The  last  part  of  the  COP,  the  Five-Minute  Observation 
(FMO),  is  coded  four  times  an  hour  immediately  after  the  Preamble  and 
is  used  to  record  interactions  among  people  in  the  classroom.     One  per- 
son, the  preselected  focus  adult  or  child,  is  followed  throughout  the 
5-minute  observation  period  and  the  activities  and  interactions  of  wiiich 
he/she  is  a  part,  and  only  these,  are  recorded. 
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(i)    The  Inscrument — The  1^0  consists  of  76  frames,  with 
four  sections  in  each  frame,  specifically  for  recording  four  types  of 
categories:     '*Wlio  does  the  action?"  "To  whom  is  it  done?"  "What  is  done?" 
and  "How  is  it  done?"    These  categories  are  coded  in  sequence  to  form  a 
sentence  (subject,  verb,  object),  which  represents  an  interaction.  The 
subsequent  frame  is  used  to  code  a  response  (if  any)  or,  in  the  case  of 
a  one-way  communication  (such  as  a  teacher  lecturing  or  a  child  manipu- 
lating materials),  continues  to  describe  the  primary  action.     Since  sev- 
eral of  the  educational  models  being  evaluated  encourage  the  mobility  of 
children  and  adults,  it  was  necessary  to  devise  components  in  the  instru- 
ment to  record  movement.     Nonverbal  behavior  and  child-to-child  inter- 
action are  also  considered  important  components  to  be  observed. 

The  FMO  observations  are  structured  as  a  language, 
with  the  codes  forming  intelligible  sentences*    The  Who  and  To  whom 
codes  are  used  to  designate  the  participants  in  an  interaction.  These 
codes  make  it  possible  to  designate  the  person  or  group  of  persons  in- 
itiating or  receiving  an  action.     The  letter  T  is  used  to  designate  the 
teacher  as  the  initiator  (Who)  or  receiver  (To  whom) ,  and  M  refers  to 
such  machines  as  typewriters,  tape  recorders,  and  filmstrip  viewers. 
The  same  applies  to  the  use  of  C  for  child,      for  small  group,  and  so  on. 

The  l^at  codes  are  used  to  designate  the  kinds  of 
Interaction — such  as  questions  or  statements — ^that  have  occurred  between 
the  participants.     The  How  column  codes  are  modifiers.     They  supply  ad- 
ditional information  about  the  initiator  in  the  Who  column  or  the  inter- 
action that  was  coded  in  the  What  column;  for  example,  they  indicate 
positive  or  negative  effect,  subject  content,  control  systems,  and  use 
of  objects. 

Examples  of  coded  frames  are  shown  in  Figure  3. 
They  demonstrate  how  the  Who,  To  whom,  What_,  and  How  codes  can  be  strung 
together  to  form  interaction  sentences. 


(ii)    The  LanguagB—The  significant  features  of  the  FMO 
language  are  that  the  categories  are  carefully  defined  to  include  ele- 
ments of  educationally  significant  events;  the  language  of  the  catego- 
ries has  a  predefined  syntax;  and  the  collection  of  data  (code  sentences) 
in  sequence  enables  strings  of  sentences  to  be  formed. 

The  Vocabulary — The  vocabulary  of  the  FMO  language 
identifies  events  and  participants  in  the  classroom.     The  first  two 
categories  of  the  vocabulary  designate  the  classroom  roles  of  the  people 
involved 
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*Operational  definitions  may  be  found  in  Appendix  D. 
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1  '  Who 

0O0O 

000© 


0OOO0OOO© 


To  VVIiom 

000 
000 


O0©0O( 
©0000000 


Whcit  Ho 

0000 

0 

Q©  (0OIO00  [0^ 


A  complete  mteractjon  sequence  will  take  two  or  more  frames  showing  at  least  the  initiation  of  an  mteractjon  and 
the  response  to  that  mitiat  mteiaction.  An  exannple  of  an  interaction  sequence  is  shown  below. 


Teacher        "Johnny,  what  is  two 
and  two^" 


The  teacher  (T  in  the  Who  column)  is  initiating  an  interaction  with  a 
child  (C  in  the  To  whom  column)  by  asking  a  simple  question  ( IQ  m 
the  What  and  How  columns)    (A  more  detailed  explanation  of  the 
codes  appears  in  Appendix  D.)  This  is  coded  in  shorthand  as  TCIQA. 
)t  IS  coded  in  the  frame  as  shown  below. 


Who 


©©© 
O©©0® 


To  Whom 

©0© 
10© 
©00® 


What 

I©®®©© 
©0®©0 
00 


How 


©0© 
©0 
;o)0R)  f®^ 


Johnny 


It  IS  four." 


Johnny  (C  in  the  Who  column)  responds  {3A  in  the  What  and  How 
column)  to  the  teacher  (T  m  the  To  whom  column).  This  in  shorthand 
IS  CT3A.  It  IS  coded  m  the  frame  as  shown  below. 


Teacher 


"That  IS  correct, 
Johnny." 
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Who 


©©©© 


©©0®©©©@ 


To  Whom 

»©0 

©0© 


What 


00©®©©©©© 

00 


©0®©0©0© 


How 


^©©0  [©0 


The  teacher  (T  in  the  Who  column)  tells  Johnny  (C  in  the  To  whom 
column)  that  she  acknowledges  (7A  in  the  What  and  How  column)  his 
correct  response.  This  m  shorthand  is  TC7A.  It  is  coded  in  the  frame 
as  shown  below 
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Who 


©#©© 

©©@© 
©000® 


What 


To  Whom 

00© 

i©© 

©0000©  l^@©© 


0©®©00©©© 


©#®©©©0© 


How 


©(o)(p) 


FIGURE  3     CODED  FMO  FR.\MES  SHOWING  CODING  OF  A  TYPICAL  INTER/\CTION 
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Subject  and  Object 
(Who  and  To  whom) 
Categories 


Code 
Vocabulary 


Teacher  T 

Aide  / 

Volunteer  V 

Child  C 

Different  child  D 

Two  children  2 

Small  group  S 

Large  group  L 

Animal  An 

Machine  M 


The  third  category  of  the  vocabulary  names  the  events: 


Verb 


(What) 

Code 

Category 

Vocab ularv 

Command  or  Request 

1 

Direct  Question 

IQ  (Q 

Open-Ended  Question 

2 

Response 

3 

Ins  true tion ,  Explanation 

4 

General  Comments/General  Action 

5 

Task-Related  Comment 

6 

Acknowledge 

7 

Praise 

8 

Corrective  Feedback 

9 

No  Response 

10 

Waiting 

11 

Observing,  Listening 

12 

Nonverbal 

NV 

Movement 

X 

The  fourth  category  of  the  vocabulary  modifies  the  initiator  or  the  ac- 
tion: 
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^1, 


Modifier 

(How) 
Category 


Code 
Vo  ibularv 


Happy 

H 

Unhappy 

U 

Negative 

N 

Touch 

T 

Question 

Q 

Guide/Reason 

G 

Punish 

P 

Object 

0 

Worth 

W 

Dramatic  Play/Pretend 

DP 

Academic 

A 

Behavior 

B 

These  categories  of  the  vocabulary  summarize  the  es- 
sence of  an  occurrence,  rather  than  giving  the  content  or  the  actual  words 
used.     For  example,  when  praise  occurs,   the  COX  language  simply  identi- 
fies the  occurrence  of  praise  and  may  differentiate  the  subject  matter 
by  modifiers  coded  in  the  same  frames.     Thus,  praise  for  a  response  re- 
lated to  academic  (cr  to  nonacademic)  subject  matter  can  be  distinguished 
from  praise  for  deportment  (see  Example  1  below). 


Praise  for  non- 
academic  subject 
matter 

Praise  for 
deportment 


Actual  Sentence 


"What  a  pretty  painting  you've  done!" 

"I'm  really  proud  of  you,  class,  for 
behaving  so  well  while  Mr.  Jones  was 
here." 


Coded 
Sentence 


TC3 
TL8B 


Praise  for 
academic  subject 
matter 


"You  read  that  section  beautifully,  Jim."  TC8A 


There  is  also  a  word  in  the  vocabulary  (marked  on 
the  FMO  frame  to  the  left  of  the  four  sections)  that  specifically  indi- 
cates that  the  code  sentence  is  not  a  part  of  a  sequence  of  events,  but 
is  to  be  considered  as  happening  at  the  same  time  as  the  immediately 
preceding  sentence:     S  (Simultaneous).     This  is  used  primarily  to  show 
inattention  of  children  when  the  teacher  or  a  machine  is  instructing. 
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In  addition,   there  is  a  symbol  to  indicate  that  an  entire  sentence  recurs 
in  the  sequence:    R  (Repeat).    Another  symbol  indicates  that  a  sentence 
is  in  error  and  should  be  eliminated  from  the  data  set:     C  (Cancel). 


The  Syntax — The  rules  for  combining  the  elements  of 
the  vocabulary  are  quite  complex.     Several  general  rules  are: 

-    A  valid  interaction  sentence  must  contain  words 
for  ]^ho,  To  whom,  and  What. 

The  sentence  may  or  may  not  include  vocabulary 
elements  as  to  How  the  interaction  is  performed. 

"    The  sentence  may  be  described  as  being  the  same 
as  the  preceding  sentence  using  R  (Repeat). 

Thus  a  code  sentence  can  be  described  as  a  sequence  of  three  or  four 
vocabulary  elements  coded  within  a  frame.     The  difficulty  lies  in  train- 
ing the  observer  to  accept  the  given  operational  definition — and  only 
that  definition — so  that  the  code  stands  for  a  recognizable  act.  There 
also  are  a  few  code  sentences  with  special  instructions  for  use  and  with 
special  meanings;  e.g.,  TT5NVX  followed  by  five  cancel  symbols,  which 
indicates  that  the  teacher  (as  the  focus  person)  has  left  the  classroom. 

C.      Selection  and  Training  of  Classroom  Observers 

Since  the  classroom  observers  provide  the  study  data,  the  selection 
and  training  of  the  observers  are  of  critical  importance  to  its  success. 
SRi's  Field  Operations  staff  selected  the  observers  from  the  local  com- 
munities and  an  effort  was  made  to  choose  observers  with  cultural  back- 
grounds similar  to  the  study  population. 

1.      Selecting  Classroom  Observers 

Two  observers  for  each  site  were  hired  by  the  Field  Operations 
staff.     One  exception  to  this  was  PS  77X  in  New  York  City,  where  only 
one  observer  was  hired  because  of  the  small  number  of  Follow  Through 
classes  available  for  observation.     The  decision  to  use  two  observers 
per  project  rather  than  one  was  made  because: 

The  observations  had  to  be  completed  in  less  time  than  was 
possible  for  one  observer  to  accomplish  alone. 

-    A  second  observer  could  provide  backup  in  the  event  one 
observer  was  unable  to  complete  all  of  hJs  observations. 
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In  selecting  observers,  the  Field  Operation?  staff  sought  the 
following  qualities  and  qualifications: 


-  Personal  ability — The  ability  to  learn  rapidly,  retain 
information,  and  build  concepts  around  given  symbols. 

-  Education— A  college  degree  was  considered  desirable  but 
not  essential.    Applicants  with  training  in  specific  edu- 
cational approaches  were  considered,  but  with  caution,  be- 
cause they  might  not  accept  a  sponsor's  approach.  Ex- 
school  teachers  were  scrutinized  with  care,  also  because 
of  possible  bias. 

-  Attitude — Observe^rs  were  expected  to  have  a  professional 
attitude  towards  :he  data  collection  effort,  which  included 
objectivity  in  dealing  with  the  data  and  the  ability  to 
treat  all  data  as  confidential. 

-  Residence— Observers  should  be  from  the  local  Follow  Through 
community  and  should  speak  the  language  of  the  community. 
However,  applicants  who  were  part  of  the  school  system,  or 
related  to  Follow  Through  personnel  were  not  eligible  to 

be  observers. 

"    Experience — The  observers  were  required  to  have  had  experi- 
ence in  working  with  children. 


2.      Training^ Classroom  Observers 

An  SRI  training  team  consisting  of  one  coordinator  and  six 
trainers  trained  all  the  observers  in  a  total  of  three  training  sessions. 
Each  session  lasted  seven  days.    The  first  two  training  sessions  were 
held  in  Palo  Alto,  California,  and  the  third  one  in  Cambridge,  Massa- 
chusetts.    Trainees  from  each  of  the  sites  were  assigned  to  one  of  the 
three  training  sessions  by  SRI  on  the  basis  ot  school  closing  dates  and 
subsequent  evaluation  activity  schedules. 

During  the  planning  stages  of  the  data  collection  effort,  sev- 
eral sponsors  expressed  interest  in  using  the  SRI  observation  instrument 
to  observe  classrooms  not  included  in  the  sample.     Some  sponsors  indi- 
cated a  desire  to  modify  the  SRI  instrument  to  gain  information  more 
specific  to  their  model  goals.     At  their  request,  SRI  agreed  to  train 
interested  representatives  of  the  sponsors  --^t  one  of  the  three  scheduled 
training  sessions.     In  addition,  SRI  offered  to  assist  the  sponsors  in 
modifying  the  instrument  for  their  own  purposes. 

The  training  locations,   training  dates,  and  project  and  sponsor 
participants  at  each  training  session  were  as  follows: 
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•  * 

 . , 

* 

1 

> 

4 

ERIC 


ERIC 


/. -  rr..vioa-l  '  r.Qtv^,  eight  c-  il<!r^.'n  vere  .^cluctcti  anJ 
1-  in    r;.ri:      r r  i      :o    i'l-       ---r  vation.     Bej^innirg  at  the 

t^-        t;  _  l--t»  I      lirst  2:.ur  cmlurt-n  present  in  the  classroom  on 
1 1^  o  --rv^i.on  i^v  V.  f t^b^-rvec.     In  order  to  obtain  niaxir:.an  variation 
.r.   :     .  r    •  ic^r  cMl  ir^-n  ^'-L-r^*  o^^-*jrvtfd  t  *vo  tirx'S  e.jcii  on  a 

r.t-t.^r.  -i.rin^,  t  4r    ntirv  cla-^s  cav.^ 


I-;  c^^itfc^n  ic  a-tjal  classroon  obs*;r /:itions ,  obscr*'- 

r*-*uir»  i  "let*-  adz:inistrative  tas'*-s  on  n  daily  and 

-  .'-ir.ini^-lrctive  c'^nsistod  o:  conpV  tinp,  the  --'oe'  lv 

:ZriS-r^trt  ;bs-^rvvr  Daily  I*cg,  editing  the  observa- 
*     t     ^' :  :r^i,  4^-;^  rct^;rr,;nj:  the  r^terial  to  SHI. 


Kcisicr  List — ^Thc  'Aeekly  Roster  List  server 
:  -  :     It  '  Tcride^  *'     i^rs*:rr*/c *it:;  a  way  o:  chec'i^^inj'.  their 

*rr*   it  :      -ri     f  ^^zu  it  provicc-c  SKI  vi th  a  weekly  inven- 

:-  r    T^-  z  trc       -  ic-   «^<rrv:r'<  vcrk.    The  Weekly  Roster  List  was  re- 
t^r^^  ti  «t  t^i^  ^r.i       ^a^h  v^ek,  along  vith  the  observation  book- 

lets z^T^-l^i^-^  trat  v**ek     s<-L-  App:^ni£>:  £  for  cetaiiec  inforr^ation  col- 


ll^^tT^o^  Ob^^rvvr  I^aily  Leg — Tt.^  Classroo:^  Observer 
-  tc  coll  ct  information  about  th#*  nateriais  used 

€tfcrv^tior*5.     !t  alsc  served  as  a  daily  Ir^y 
^  w.^^-i  t:^^  ^t^^jrvtr  vas  involvtrd;  a  recor'*  of  events 
^4?£  :^  t:.^  or^er-.'atlon  procedure;  and  a  record  of  tht.- 
w^_^  irvvlv«        the  obser'/^rd  cla«^roo:^.     The  Class- 

ic v^s  r-^t^m^d  tc  Sj!i  f^!lcr*:nH  thv  completion  c: 

.\.ri-n:i:x  I  fcr  I-tails        tr,e  :nfi?rTtatlon  o^- 


r:er^rr:  to        — A: 


-nd  o: 


^-iit  th^fir  vcr>  and  t-  :^ake  entries 
'  f  ^* '     ,s  : .  V  '  k  t ' :  e       t  e  r  i  a  I  >  v*?  r- 


E .  Summary 


Data  were  collected  from  36  sites  representing  seven  sponsors.  The 
sites  range  in  location  from  rural  areas  to  large  metropolitan  areas.  All 
geographical  sections  of  the  country  are  represented  in  the  sample.  The 
sites  vary  in  ethnic  composition  from  no  black  children  in  four  Follow 
Through  sites  to  100%  black  children  in  four  sites  (see  Table  3).  Fifteen 
sites  have  children  who  speak  English  as  a  second  language.     The  children 
enter  school  with  differing  ability:     e.g.,  the  highest  baseline  mean 
score  in  first  grade  was  recorded  for  University  of  Kansas  in  New  York 
(36.8),  while  the  lowest  first  grade  baseline  mean  score  was  for  High/Scope 
in  Ft.  Walton  Beach,  Florida  (18.2).     The  percent  of  children  still  en- 
rolled one  year  after  having  the  baseline  test  is  also  of  interest*  This 
number,  which  indicates  the  stability  of  the  school  populations,  ranges 
from  81%  still  remaining  in  school  in  Newark  first  grades  to  only  29%  re- 
maining in  Lakewood  first  grades.     Clearly  there  are  great  differences 
among  sites  in  demographic  characteristics  and  these  differences  need  to 
be  considered  when  interpreting  implementation  data. 

Two  days  of  adult-focused  and  one  day  of  child-focused  obser'^'ations 
were  conducted  in  classrooms  which  ideally  had  baseline  data  for  at  least 
20%  of  the  children.     In  28  first  grades  and  77  third  grades,  the  20% 
baseline  criterion  could  not  be  adhered  to*     These  classrooms  were  observed 
but  were  not  included  in  analyses  requiring  test  data. 

The  observation  instrument  used  was  developed  specifically  for  use 
in  Follow  Through  classrooms*     It  records  classroom  environments,  activi- 
ties, and  interactions.     Training  procedures  have  been  carefully  developed 
to  ensure  observer  reliability.     These  procedures  include  specifications 
f  »r  hiring  observers  as  well  as  crite  ia  for  allowing  a  trainee  to  observe. 
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Cliapt  or  IP 


Tlie  variables  us^d  in  this  classroom  observation  stu^W  w^ro  tornu- 
ialL'd  not  only  from  the  Classroom  Observation   Instrument   (COI),  but  also 
t  rom  tho  teacher/aide  ques  tionnai  re.s ,   the  test  scores,  and  demop.rapb.  i  (, 
data.     Descriptions  of  tiic  process  by  \;hich  the  data  from  these 
sources  were  converted  into  variables  <ire  presentc^d  below  under  the 
r(»l»^vanL  cate^orv  headin:;s. 


•       ^ 'J  * L izHlll Oi^se  rv.i  L  i  en  _ Ln,->  irnnt.  nt   (CO  I )  Variables 

'I he  COI   Is  dc.^i<;nea  to  record  classroom  arrangements  and  elements 
of  events  considered  educationally  significant  by  Lh(>  sponsors.  Since 
there  are  over  100,030  possible  conbinations  of  codes  v;hich  could  forn 
variables,  it  was  important  to  formulate  only  those  variables  ronsi(h>re(^ 
to  be  of  relevance  to  the  study  of  sponsor  implenentation .     This  section 
will  describe  the  processes  used  to  transform  codes   from  each  portion  of 
the  classroom  observati-on  instrunent  into  variables. 

The  t  iasnrooni  is  the  unit  of  analysis  for  most  of  the  <malyses  in 
thi^s  study;  therefore,  eac'n  classroom  was  assigned  a  value  on  a  given 
variable  based  on  the  sum  of  the  frequency  of  occurrence  of  the  vari- 
able for  the  observation  days.     The  Physical  Environment  Information  {?VA) 
and  Classroom  Check  List  (CCL)  were  summed  over  three  days.     The  Five  '!in- 
ute  Observation   (F>\0)  variables  differ  from  the  PHI  and  CCL  in  that  the 
data  collected  durin^^  adult-focused  observation  and  summed  across  t\;o 
davs,  \;hereas  the  chi Id- foe used  variables  are  based  on  one  dav  of  individ- 
ual child-focubcd  observations  in  each  classroom.     Appendix  F  lists  ill 
of  the  COi  variables  created  for  tais  study.     'lany  of  tiie  variable^  <ire 
not  mutually  exclusive.     Appendix  0  provides  tiie  soc»ci f ications  for  the 
ob.^ervation  variables  used  in  tlie  analysis.     These  specifications  de- 
scribe which  variable^  are  added  to  make  new  variables.     The  variabiles 
ar*'  numbered  in  a  continuoub  series   (from  1  t'nrougli  ^•)02)  rather  th.an  b> 
section  of  the  observation  instrument. 


^  •       ^A']LliIi y.^l  A^n^l^^y,  Jj ^  f_o_r ^la  1 1  oi i  ((.si)-  Va r  iab_l_e 

InU)rnati(;r  rtHorded  on  (SI  diiring  the   fir-.t  d<iv's  ob^erv<ition 
\'i  >        d  10  uTi^a^.e  tile  var»aM«  ^  fiat   id'>ntifv  a  ila^sroom  bv  spon^n)t  , 

M  e  Appendix  C   for   tiio  in'-trument. 


site,  teacher,  grade,  observer  and  the  like  (Variables  1-9).     The  vari- 
ables that  describe  the  numbers  o[  adults  and  children  present.  Vari- 
ables 10- U,  were  obtained  by  averaj^ing  the  sums  of  the  numbers  recorded 
on  the  protocols  during  the  three  observation  days.     To  obtain  Variable 
15  (Child/Teacher  and  Aide  Ratio),   the  total  number  of  children  present 
on  each  observation  day  was  divided  by  the  total  number  of  teachers  and 
aides  present.     To  obtain  Variable  16   (Child/Adult  Ratio),   the  total 
number  of  children  present  each  day  was  divided  by  the  total  number  of 
teachers,  aides,  and  volmiteers  present.     An  average  ratio  over  the  three 
days  was  then  computed  for  both  of  these  variables.     Variable  17  (Total 
class  duration)  was  computed  by  averaging  the  number  of  class  hours  re- 
corded for  the  three  days  of  observations.     (Appendix  F  contains  a  list 
of  the  CSI  variables.) 

2 .  Physical  Environment  Information  (PE1)^<  Variables 

The  PLI  Section  of  the  COI,  completed  once  each  observation  dav 
collects  two  kinds  of  information:     (1)  seating  and  work  group  patterns, 
and  (2)  equipment  and  materials  present  and  used  in  the  classroom. 

The  definitions  for  the  variables  in  the  first  category  (Vari- 
ables 18  to  24)  are  taken  directly  from  the  instrument;  e.g.,   if  the  item 
"Movable  tables  and  chairs  for  seating"  is  marked  on  the  protocol,  tiie 
value  assigned  to  Variable  18  is  1;  if  the  item  is  not  marked  on  the 
protocol,  tlie  value  for  Variable  18  is  0. 

Variabjes  in  the  second  category  (Variables  25  to  43)  are 
scored  1_  if  the  protocol  was  marked  "present,"  and  zero  if  it  was  not 
marked.     The  variables  are  also  scored  I        the  protocol  was  marked  "used 
'^^^  ^^^^  i-^  not,     Cach  variable  is  then  assigned  the  value  of  the  sum  of 
its  two  scores.     (Appendix  G  contains  a  detailed  specification  of  how 
each  PHI  variable  was  computed.) 

3 .  Ciassroon;  Check  List  (CCL)^'^  Variables 

liiis  year,  in  addition  to  computing  tlie  CCL  variables  by  fre- 
quency of  occurrence  as  we  have  done  in  the  past  three  years,  a  weighting 
scheme  was  devised  that  takes  into  account  the  number  of  childr^-n  in- 
volved in  various  activities.     In  the  past  we  reported  only  that  children 
were  involved  in  a  reading  activity  during  a  particular  pe^-ccnt  of  the 
observation  period.     Since  we  did  not  report  how  many  children  were  in- 
volved in  reading,  one  child  reading  was  scored  the  same  as  a  large  group 
reading*     By  the  weighting  procedure,  we  now  can  determine  approximately 
how  frequently  one  child,   two  children,  small  groups,  or  large  groups 
were  engaged  in  reading  or  other  specific  activities. 


*See  Appendix  C  for  the  i  nst  nirru'nt . 
^*I i lus trated  on  page  26. 


llic  U'L  variables  havo  bcun  broken  down  into  Categcrii's  A 
through  K,  ea^h  ot  which  dclines  <i  parLlmlar  area  ol    interest  to  this 
study  (sec  Appendix  K) .     Category  A  comprises  the  variables  that  de- 
scribe the  Irequencv  ot   oci  urren^  i»  of  specific  activities   (e.^;.,  Group 
ti:ne,  Matli,  Dramatic  pluvj;  Category  B  conpribes  variables  that  denote 
the  frequency  ot  occurrence  of  the  different  j.;roupings  ol   adults  and 
^tiildren  found   i'l  each  classroom  tor  <i  1  1  activities   (e.^-?   -Xuie  with 
snail  -;roup  of  children,  one  chilJ.  without  an  adult);  Categories  C 
tb.rougii  I  comprise  variables  that  show  the  frequency  of  groupings  within 
particular  activities   (e.g..    Teacher  with  two  children  in  math  activitv, 
Small  group  without  adult  in  reading  activity,  Volunteer  involved  in 
classroom  management);  and  Category  d  variables  reflect  the  use  of  spec- 
ial materials  or  equipment   (e,g.,  texts  or  workbooks,  audiovisual  equip- 
ment) within  the  activities  of  math,  reading,   social  studies,  and  science 
('ategory  K  variables  wiiicn  describe  <ictivities  and  groups  are  the  sane  as 
tliose  used  in  preceding  years,  and  are  computed  as  they  were  in  the  past 
in  order  to  examine  longitudinal  trends. 

The  v/oighting  scheme  of  the  CCL  variable  is  described  in  detail 
in  Appendix  G. 

A.       Preamble  (PRE)>-  Variables 

There  are  three  categories  of  preamble  variables,  which  include 
(1)  Focus  of  the  FMO — comprised  of  variables  that  denote  the  focus  person 
for  the  5-ninute  observation  period  and  the  size  of  the  group  witli  which 
that  person  is  interacting;    (2)  Adult  Role — the  variables  that  describe 
whether  the  teacher  and  aide  are  directing,  observing,  participating,  or 
not  involved  in  the  activity  in  whicli  the  focus  person  is  engaged  at  the 
beginning  of  the  3-minute  interaction  observation;  and  (3)  Activity/ 
General — variables  that  indicate  the  activity  in  which  the  focus  person 
is  engaged  at  the  beginning  of  the  5-minute  observation  period,  and  those 
FMOs  that  both  begin  and  end  with  a  math  or  a  reading  activity. 

A  score  of  1  is  attributed  to  each  occurrence  of  a  PRE  variable 
recorded  on  the   protocol  and  zero  if  none  is  recorded.     Fhe  variables 
related  to  the  focus  on  the  F:I0  and  the  adult  role  are  expressed  as  p^r- 
cents  of  FMOs.     Ihe  PRF  variables  are  listed  in  Appendix  F  and  the  de- 
tailed specifications  are  found  in  Appendix  C. 

3 .       Five-Minute  Observation  (IvlO) Variables 

The  rAO  portion  ot   the  CGI  is  used  to  record,  in  the  form  of 
coded  sentences,  interactions  that  occur  in  the  classroom.     Because  the 


''Illustrated  on  page  27. 
•'■-'Illustrated  on  page  29. 
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possible  permutations  of  the  RIO  codes  total  something  over  100,000 
sentences,  it  is  necessary  to  limit  the  number  of  variables  which  are 
formed  to  those  that  seem  most  appropriate  to  the  sponsors'  models  and 
to  the  analyses  planned  for  this  study.     The  131  FMO  variables  selected 
on  this  basis  are  listed  in  Appendix  F,  and  defined  in  Appendix  G.  The 
same  set  of  FMO  variables  is  used  for  adult-focused  and  for  child-focused 
observations,  but  the  variables  are  numbered  differently  for  each  focus 
(i.e..  Variables  341a  to  471a  are  for  adult-focused  and  Variables  472c 
to  602c  are  for  child-focused  observations). 

The  Y}10  variables  were  selected  and  named  to  describe  interac- 
tions relevant  to  sponsors'   implementation.     The  variables  are  defined 
by  appropriate  code  combinations  or  sentences.     In  some  cases,  the  def- 
inition of  the  variable  corresponds  directly  to  one  or  two  specific  coded 
sentences   <'e.g..  Variable  380a  and  511c,  "Child  Self-Instruction,  Aca- 
demic, with  Objects,**  is  limited  to  a  single  child^s  specific  activity 
and  permits  only  two  kinds  of  code  combinations:     CC4NVA0  and  DD4NVA0). 
Other  definitions  encompass  many  possible  code  combinations;  e.g..  Vari- 
able 341a  and  472c  (Child  to  Adult,  Verbal)  includes  all  interaction 
frames  that  show  any  child  code  (C,D,2,S,L)  in  the  Who  category;  any 
adult   (T,A,V)   in  the  To  whom  category;  any  verbal  code  (1,2,3,4,5,6,7,8,9) 
in  the  Wliat  category;  and  any  code  in  the  How  category  (thus  yielding 
a  possible  135  different  kinds  of  code  combinations  or  sentences). 

Generally,   the  FMO  variables  describe  child  and  adult  verbal 
interactions   (i.e.,  questions,  responses,  instruction,  comments,  and 
feedback)  and  nonverbal  interactions   (i.e.,  nonverbal  requests,  responses, 
self-instruction,  feedback,  waiting,  and  observing/listening).     In  some 
cases,  these  FMO  variables  are  further  defined  by  the  How  category  niod- 
ifiers   (such  as  academic,  social  behavior,  happy,  negative).     A  few  vari- 
ables are  defined  by  the  sequential  ordering  of  certain  interaction  frames 
(e.g.,  *'Adult  question"  followed  by  "Child  response"  followed  by  "Adult 
feedback");  while  other  variables  are  summing  variables   (e.g..  Variable 
457a  and  588c,  "All  adult  positive  corrective  feedback"  includes  or  sums 
the  variables  that  define  adult  positive  corrective  feedback  for  academic, 
other  task-related,  and  behavioral  responses).^ 


*More  specifically,  cc        tive  feedback  given  to  a  child  when  his  action 
or  response  is  not  acc        Die  is  defined  by  modifiers  from  the  How  cate- 
gory.    The  Wliat  code  'Corrective  Feedback")  must  be  modified  by 
"Question"  or  "Guide"  from  the  How  codes  to  form  the  variable  "Positive 
Corrective  i-eedback,"  or  by  "Negative"  or  "Punish"  from  the  How  codes 
to  form  the  variable  "Negative  Corrective  Feedback."    When  the  feedback 
to  the  child  is  that  his  response  is  correct  or  acceptable,  "Positive 
Feedback"  is  used.     "Positive  Feedback"  is  a  summing  variable  that  in- 
cludes both  "Acknowledgment"   (_7)  and  "Praise"  (8^).     The  feedback  is 
given  for  either  academic  performance,  other  tasks,  or  behavior.  All 
of  the  feedback  variables  are  subsets  of  a  more  global  variable  called 
"All  feedback." 
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B .  Teacher  and  Teacliinj^  Aide  Questionnaires 

The  Teacher  and  Aide  Questionnaires  were  developed  to  provide  in- 
lormatLon  about  the  teachers  and  aides,  such  as  number  of  years  in 
Follow  Through,  Follow  Through  training  received,  and  their  attitudes  to- 
ward the  Follow  Through  model.     Responses  to  the  teacher  and  teaching 
aide  quostionnairub  were  received  Erom  328  teachers   (260  from  Follow 
Throuj;h  and  63  from  Non-Follow  Through  classrooms)  and  38^1  teaching  aides 
(355  from  Follow  Through  and  29  from  Non-Follow  Through  classrooms)  in 
the  observation  sample.     The  specific  questions  relating  to  training, 
satisfaction,  and  background  experience  provided  the  data  used  in  this 
study  of  implementation. 

The  teacher  and  aide  reports  of  their  training  in  the  sponsor's 
model  are  of  special  interest  because  they  provide  some  idea  of  how  the 
sponsors  have  been  able  to  change  the  behavior  of  in-service  teachers: 
ic  is  of  interest  to  see  whether  certain  training  methods  or  teacher 
characteristics  are  related  to  high  implementation  scores. 

In  addition,  several  characteristics  of  classroom  personnel  were 
examined  to  see  whether  they  were  related  to  model  implementation.  Such 
factors  as  Teacher/Aide  satisfaction  with  the  educational  model,  previous 
education,  and  the  number  of  years  spent  teaching  in  the  Follow  Through 
program  were  investigated  to  see  how  they  were  related  to  successful  im- 
plementation (if  at  all).     The  items  selected  from  the  questionnaires  and 
the  related  analysis  specifications  are  reported  in  Appendix  H. 

C.  Tests 

Baseline  data  were  available  for  25  of  the  first  grade  sites  and 
25  of  the  third  grade  sites  (see  Table  1),     The  contents  of  the  Follow 
Through  test  battery  have  changed  over  the  years  of  the  longitudinal 
study,  and  differ  across  grade  levels  for  each  year  of  administration. 
The  changes  in  the  battery  reflect  the  effort  to  adopt  instruments  that 
appeared  more  reliable  and  more  valid  than  those  first  used.     The  follow- 
ing tests  were  used  in  the  present  analysis: 

Baseline  (pupils  entering^  school) 

-    Wide  Range  Achievement  Test  (W!IAT) . 

Post  Tests  (pupils  having  had  some  school) 

Metropolitan  Achievement  Test  (MAT) — first  grade  and 
third  grade. 

Raven's  Coloured  Progressive  Matrices  (Raven's), 
third  grade. 


-  Coopersmith  Self-Esteem  Inventory  (Coopersmi th) , 
third  grade. 

-  Intellectual  Achievement  Responsibility  Scale  (lAR) , 
third  grade. 

(See  Appendix  I  for  a  description  of  analysis  specifications  for 
these  tests. ) 

1 .  Baseline  Test  Data — The  Wide  Range  Achievement  Test  (WRAT) 

The  WRAT — highly  correlated  with  the  MAT — is  the  baseline  test 
for  the  study  because  it  is  the  only  test  that  was  administered  consis- 
tently  during  the  first  three  years  of  Follow  Through.     The  WRAT  was 
initially  used  in  the  Follow  Through  evaluation  because  it  is  a  short, 
multi-level,  single  instrument  achievement  test  that  measures  achievement 
in  reading,  spell-'ng,  and  arithmetic.     The  1965  version  of  the  WRAT  test 
(J.  F.  Jastak  and     .  R.  Jastak)  is  standardized  and  norms  have  been  es- 
tablished, but  the  appropriateness  of  these  norms*  for  the  Follow  Through 
sample  has  been  questioned.     For  this  reason,  the  MAT,  which  has  been 
standardized  on  a  larger  population,  and  which  examines  achievement  in 
greater  depth  at  each  grade  level,  was  substituted  for  the  l-JRAT  as  a  mea- 
sure of  achievement  in  the  Spring  of  1972. 

2.  Post-Test  Data  (Spting  1973) 

a.  Metropolitan  Achievement  Tests   (MAT)  Form  F 

These  tests  (by  Durost  et  al.,  l^^O)  were  first  included 
in  the  national  Follow  Through  evaluation  in  Spring  1972.     They  were 
selected  because  they  cover  several  areas  of  achievement,  have  norms 
based  on  a  standardization  sample  that  includes  children  of  low-income 
families,  and  are  reliable.     The  subscores  from  the  MAT  Primary  I  Test 
for  word  analysis,  total  reading,  and  math  were  computed  for  the  first 
grade  children.     Subscores  from  the  MAT  Elementary  Test  for  total  read- 
ing, language,  math  computation,  math  concepts,  math  problem  solving, 
and  total  math  were  computed  for  the  third  grade  children. 

b.  Raven's  Coloured  Progressive  Matrices  (Raven's) 

This  test  was  originally  designed  by  John  C.  Raven  (1956, 
1962)  as  a  *'culture-fair nonverbal,  intelligence  test,  but  SRI  uses 
the  test  as  a  measure  of  a  child's  problera-soTving  ability  in  visual 


*The  norms  were  based  on  a  sample  for  fewer  than  2,000  pupils  (5-8  years 
old)  and,  according  to  the  technical  manual  *'no  attempt  was  made  to  ob- 
tain a  representative  national  sample"     (Jastak  and  Jastak,  1965,  p.  9) 
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perceptual  tasks.     I2ach  test  item  presents  the  child  with  a  pattern  from 
which  a  piece  is  missing  and  the  child  is  asked  to  select  the  appropriate 
piece  from  several  alternatives.     SRI  prepared  and  uses  an  abbreviated  27- 
item,  group-administered  ve  rsiou  of  the  original  Raven ' s .     Instruct  ions 
were  adapted  by  SRI  from  the  1965  Matrices  Guide.     These  instructions  were 
reviewed  and  accepted  by  agents  designated  bv  the  author. 

c.      Coopersmith  Seli-Hsteem  Inventory  (Coopersmith) 

The  Coopersmith  is  a  noncognitive  instrument  designed  by 
Stanley  Coopersmith  (1967)  to  assess  a  child's  feelings  of  self-esteem. 
The  test  measures  a  child's  feelings  about  himself,  the  way  he  thinks 
other  people  feel  about  him,  and  his  feelings  about  school.     The  test 
contains  58  items,  each  of  which  consists  of  a  set  of  statements.  The 
child  is  asked  to  select  whi^.h  of  the  statements  is  "like  me"  or  "not 
like  me."    The  SRI  version  of  the  Coopersmith  test  was  group  administered 
in  Spring  1973  and  contains  the  original  58  items  of  the  inventory.  How- 
ever, since  eight  of  these  items  are  used  merely  as  a  validity  check,  the 
raw  score  for  the  Coopersmith  is  based  on  the  50  items  designed  to  measure 
the  child's  self-esteem. 


d.       Intellectual  Achievement  Responsibility  Scale  QAR) 

The  lAR  (Crandall,  Katkovsky,  and  Crandall.  1965)  is  a 
group-administered,  noncognitive  measure  designed  to  assess  the  extent 
to  which  the  child  takes  responsibility  for  himself  or  attributes  his 
successes  or  failures  to  the  operation  of  internal  or  external  forces. 
Each  test  item  describes  a  positive  or  negative  achievement  experience 
and  two  alternative  explanations  of  the  event,  one  of  which  denotes  in- 
ternal control  while  the  other  denotes  external  control.     The  child  is 
asked  to  select  a  response  that  describes  whether  he  would  be  respons-ible 
for  a  particular  ovent  or  someone  else  would  be  responsible  for  tlie  event, 
e.g.,  I  read  well — because  I  study  hard  or  because  the  books  are  easy. 

Because  the  original  34-item  lAR  was  designed  for  older 
children,  SRI  rewrote  the  items  in  more  simplistic  terms  to  make  it  more 
appropriate  for  Follow  Through  third  graders.     Two  subscores  are  derived: 
one  for  those  items  related  to  a  child's  feeling  of  success,  and  the 
other  for  the  1  tens  related  to  a  child *s  feelings  of  failure.     The  items 
are  mutually  exclusive  and  a  chiJd  could  score  high  on  both  scales.  For 
both  subscores,   the  higher  the  score,   the  greater  the  indication  of  a 
chiid^s  attributing  his  successes  and  failures  to  internal  forces. 

D .      'rh e  Classroom  Rosj: e ^^"jrP^'.nio gra.ph i c  I n^forma t ion 

The  cJassroom  roster  is  valuable  because  it  provides  a  straight- 
forward and  relatively  reliable  source  of  information  about  the  pupils. 
Specifically,  the  roster  lists  the  classroom  pupils  by  name,  age,  sex, 
ettinic  group,  language  spoken  at  home,  preschool  experience,  and  the 
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amount  of  Follow  Through  services  received,  if  any.     Other  items  of  in- 
formation available  from  the  roster  are  classroom  identifiers  (roon  num-* 
ber,  principal,  school,  address,  district),  classroom  staff  (teachers, 
aides,  volunteers),  evaluation  design  information  (cohort,  grade  stream, 
grade  level),  and  whether  the  classroom  is  Follow  Through  or  Non-Follow 
Through.     Appendix  J  lists  the  information  used  in  this  analysis  from 
the  Classroom  Roster  Form. 


E.  Summary 

The  variables  flescribed  in  this  chapter  are  used  for  descriptive 
purposes  as  well  as  for  statistical  analyses.     Some  observation  vari-- 
ables  are  used  in  the  study  of  implementation,  while  other  variables 
are  used  in  the  study  of  classroom  processes  as  related  to  child  out- 
comes. 
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variaiUf  in  c  lassroom  variables.     Ihe  remaining  variability  is  assumed 
to  arise  from  error  of  measurement.     A  primary  factor  contributing  to 
error  is  the  variability  of  the  classroom  processes  from  day  to  day. 
Another  factor  is  absence  variability  from  day  to  day,  and  differences 
betv^een  absences  in  this  respect  across  classrooms.     A  high  reliability 
coefficient,  say  above  .70,  indicate^  that  the  classrooms  maintain  the 
same  rank  order  on  observed  scores  from  day  to  day.     This  v/ould  indicate 
that  error  due  to  day  to  day  variability  within  classrooms  or  absences 
is  slight  though  it  would  not  rule  out  the  possibility  of  systematic  error 
operating  across  absences. 

Tlie  reliability  coefficients  are  displayed  for  each  sponsor,  Non- 
Follow  Through,  and  all  classrooms  in  Table  5  for  the  selected  CCL  and 
FMO  variables.     The  reliability  coefficients  were  computed  separately 
for  the  first  and  third  grade. 

0\/^L  all  classrooms,  the  coefficients  are  high.     Scattergrams  in 
Figures  4  and  5  illustrate  the  variability  between  the  two  days  of 
observation  for  two  of  tb.e  variables.     The  coefficients  for  the  CCL  vari- 
ables are  above  .70  with  the  exception  of  Variable  66  (Numbers,  Math, 
Arithmetic)  for  the  third  grade,  where  the  coefficient  was  .68  (see  Fig- 
ure 6).     For  the  adult/activity  focus  FMO  variables,  the  coefficients  were 
all  above  .85  'vith  the  exception  of  Variable  374a  (Adult  instruction, 
acadeniic)  for  first  grade  where  the  coefficient  was  .74. 

For  the  individual  sponsors,  approximately  84%  of  the  140  coeffic- 
ients that  were  computed  had  a  value  of  .70  or  more.     The  reliability 
Coefficient  for  Variable  66  (Numbers,  math,  arithmetic)  was  below  .70  in 
six  out  of  the  fourteen  cases.     In  particular,  the  coefficients  were  ex- 
tremely low  for  both  grade  levels  of  University  of  Arizona,  third  grade 
of  Bank  Street  and  the  University  of  Oregon.     The  negative  coefficient 
for  Bank  Street's  third  grade  is  the  result  of  one  classroom  where  an  ex- 
tremely high  proportion  of  the  class  time  was  spent  in  math  on  the  first 
day  and  small  proportiori  of  time  was  spent  in  math  on  the  second  day. 
The  extremely  low  reliability  coefficients  for  the  University  of  Oregon 
on  Variable  66  in  the  third  grade  and  Variable  67  in  the  first  grade  are 
notable  since  this  sponsor's  program  is  considered  to  be  more  structured 
than  others. 

The  University  of  Kansas,  also  considered  to  be  more  structured,  had 
the  greatest  number  of  variables  with  coefficients  below  0.70.     Out  of  the 
ten  variables  analysed,  in  the  first  grade  which  were  analyzed  for  Univer- 
sity of  Kansas  three  variables  were  below  .70  reliability,  and  in  the 
third  gr-:  .c  two  variables  were  below  .70   reliabiMty.     The  lowest  of  these 
was  Variable  10^  (Adult  with  one  child).     This  variable  is  not  a  critical 
variable  of  the  University  of  Kansas  and,  therefore,  would  not  affect  the 
interpretation  of  their  i  .p lementation  score,     High/Scope  classrooms 
showed  the  highest  reliability.     No  first  grade  classrooms  and  only  one 
third  grade  classroom  had  a  reliability  of  lower  than  .70. 

The  other  instances  of  low  reliability  coefficients  do  not  exhibit 
any  particular  pattern,  but  rather  are  scattered  among  different 
.  i^nhinat  ions  jf   variahJ*.'S,  sponsors,  <in<J  ^rade  levels. 
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rho  ro'iability  .:oef  f  ic  ienls  for  the  Non-Follow  Through  classrooms 
are  ail   in  the  moderately  high  to  high  range.     For  the  third  grade,  the 
reliability  ooeffiLienis  for  both  Variable  66  (Numbers,  math,  arithmetic) 
and  Variable  h?  (Reading,  alphabt-t,  language)  are  slightlv  less  than  .70. 
The  one  other  variable  with  a  reliability  coefficient  less  than  .70  is 
Variable  3bOa  (Child  responses,  academic)  for  the  first  grade. 

In  summary,  the  examination  of  the  reliability  coefficients  computed 
over  all  classrooms  indicate  that  the  reliability  of  instructional  pro- 
cesses is  surprisingly  high.     The  differences  among  classrooms  account 
for  a  substantial  portion  of  the  variability  of  the  variables  we  have  se- 
lected.    The  same  conclusion  holds  with  a  few  exceptions  for  the  coeffic- 
ients computed  for  each  sponsor  and  grade  level.    The  only  variable  for 
which  the  reliability  was  low  for  several  sponsors  was  Variable  66  (Num- 
bers, math,  arithmetic). 

A  Study  of  the  Conf usability  of  the  Codes 

The  present  study  examines  the  accuracy  of  observers  coding  a  stand- 
ard set  of  stimuli.     In  this  procedure  the  observer's  bias  is  examined, 
as  well  as  the  confidence  that  can  be  placed  in  the  observation  code  it- 
self.    Through  these  procedures  the  exact  nature  of  the  confusion  of 
codes  can  be  identified. 

In  previous  SRI  reliability  studies,  the  technique  of  pairing  the 
observers  witli  an  SRI  trainer  has  been  used*''^    However,  there  are  some 
problems  in  assessing  inter-rater  reliability.     First,  there  is  some 
variability  in  the  coding  skills  of  SRI  trainers.     Second,  there  is 
most  certainly  a  variability  in  the  incidents  which  occur  in  the  class- 
rooms, in  what  is  selected  for  observation,  and  in  which  codes  are  used 
in  the  observations.     The  optimum  arrangement  might  be  to  have  all  ob- 
servers and  SRI  trainers  observe  the  same  phenomena  in  the  same  class- 
room at  the  same  time.     But,  as  Soar  (1973)  says: 

The  critical  problem  (of  paired  observers)  is  the  effect 
on  the  classroom  of  increasing  the  number  of  observers. 
One  observer  represents  a  threat  to  many  teachers  and  a 
distraction  to  the  children,  at  least  initially,  and  as 
the  number  of  observers  increases,  these  difficulties 
increase,  probably  more  like  a  geometric  function  than 
an  arithmetic  one. 

In  an  effort  to  avoid  the  problems  encountered  with  the  paired  ob- 
server method,  SRI  staff  has  attempted  to  assess  the  accuracy  of  observ- 
ers through  the  use  of  controlled  videotape  examples.     This  procedure 


''^Stal  lings  (197  3)  reports  inter-rater  agreement  of  80%+  for  frequently 
used  Who  and  What  codes  and  70'''+  for  frequently  used  How  codes. 
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allows  each  interaction  (or  frame)  antl  sequences  of  frames  to  be  anal- 
yzed for  accuracy,  whereas  previously  only  simple  marginal  frequency 
counts  of  single  codes  could  be  computed^ 

Other  investigators  in  observational  r  search  also  use  videotapes 
to  assess  observer  accuracy*     Soar  (1973)  used  tapes  of  actual  class- 
room events,  and  Simmel  (1973)  cleverl^  used  the  last  ten  minutes  of 
the  Johnny  Carcon  Show  to  check  observer  accuracy  on  a  weekly  basis. 
Although  videotapes  are  useful,  their  limitations  also  should  be  rec- 
ognized : 

-    Because  of  the  difficulty  in  seeing  and  hearing,  videotapes 
are  more  difficult  to  code  than  live  conversations; 

It  is  more  difficult  to  understand  the  gestalt  of  the 
situation  from  a  tape  than  it  is  from  a  live  situation 
in  the  classroom; 

Simulated  skits  are  likely  to  be  more  clear-cut  examples 
than  those  which  actually  occur  in  classrooms. 

1.      A  Description  of  Procedures^ 

To  check  conf usability  of  codes  and  observer  reliability  in 
a  way  different  from  that  of  either  Soar  or  Simmel,  SRI  staff  produced 
ten  videotaped  skits.     Each  simulation  is  approximately  20  interaction 
frames  long.     These  skits  attempt  to  present  concise,  clear  examples 
of  each  code  used  in  recording  classroom  interactions  on  the  SRI  ob- 
servation instrument.     Each  skit  begins  with  a  still  picture  and  the 
voice  of  a  narrator  who  explains  the  situation  and  identifies  the  focus 
person.     The  skit  is  then  shown  at  regular  speed.     After  the  skit  is 
shown  once,  the  still  picture  and  narrator  again  identify  the  focus 
person.     Each  skit  is  then  shown  again,  this  time  with  a  2-  to  3-second 
pause  between  each  interaction.     The  observers  are  instructed  to  code 
this  stop-action  portion  of  the  skit  and  to  code  one  frame  during  each 
stop  or  pause. 

These  videotaped  skits  were  administered  to  the  observers  by 
SRI  field  staff.     The  tape  was  administered  to  the  observers  when  at 
least  three-fourths  of  the  observations  were  completed  but  not  later 
than  10  days  after  the  end  of  the  observations.     This  procedure  allowed 
whole  frames  and  sequences  of  frames  to  be  analyzed  where  previously 
we  could  only  compute  reliability  on  the  basis  of  simple  marginal  fre- 
quency counts  of  single  codes. 


'^These  procedures  were  developed  at  SRI  by  J.  Philip  Baker,  Phillip 
Cicsen,  and  Charles  Norwood. 
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Ilu'  reliability  coding  booklets  were  returned  Lo  SRI  and 
compared  with  liie  criLerion  sequences^     This  revealed  that  some  ob- 
servers were  coding  more  than  one  frame  during  a  pause*  Conversely, 
some  observers,  posiibly  while  turning  pages,  omitted  frames*  The 
trainers  reviewed  the  codiiig  sequences  and  deleced  e::traneous  frames  or 
inserted  spaces  so  as  to  align  the  observers*  sequences  with  the  crite- 
rion sequences.     Three  trainers  perfonned  this  operation*     Since  judg- 
ment is  involved,  a  check  was  made  on  the  code  sequences  of  10  ob- 
servers to  see  whjther  the  trainers  arranged  the  sequences  in  the  same 
manner.     The  average  agreement  between  trainers  in  arranging  these 
sequences . was  96.4%. 

-  Other  procedural  problems  were  also  encountered  due  to  the 
experimental  nature  of  the  techniques  used.     Comments  received  from 
the  observers  indicated  that  not  all  of  the  equipment  utilized  to 
administer  the  tapes  was  in  good  condition,  and,  as  a  result,  the  sound 
or  pictures  were  of  poor  quality.     Also,  some  examples  on  the  criterion 
tape  were  technically  less  than  well  executed.     The  most  serious  prob- 
lem, however,  was  that  there  were  too  few  examples  of  several  of  the 
codes  on  the  criterion  tape.     Five  or  fewer  examples  of  a  code  limited 
the  assurance  that  representative  examples  of  the  code  were  shown. 
Further,   if  an  observer  missed  two  out  of  four  possible  instances  of  a 
code,  he  had  a  score  of  only  50%  of  the  criterion  correct;  however,  if 
he  missed  two  out  of  30  possibilities,  he  had  a  score  of  93%  of  the 
criterion  correct.     For  this  reason,   the  codes  v^/hich  have  five  or  fewer 
examples  will  not  be  interpreted  in  this  analysis.     The  number  of  ex- 
amples of  each  code  on  the  complete  set  of  tapes  ranges  from  zero  to  AC. 
(This  problem  is  being  remedied  by  the  development  of  more  skits.) 


3 .      A  Description  of  Conf usabil icy  Matrices 

Conf usability  of  codes  refers  to  codes  which  were  confi'sed  with 
the  correct  codes  by  an  observer  (see  Table  6  for  a  brief  explanation  of 
the  SRI  What  and  'low  codes).     Conf  usability  matrices  Vs^ere  constructed 
by  tallying  che  observer  code  sequences.     For  each  frame,  a  tally  mark 
was  entered  in  the  box  or  cell  created  by  the  juncture  of  the  criterion 
code  and  the  code  marked  by  che  observer .     Figure  7   shows  an  example  of 
a  conf usability  matrix  for  the  What  codes.     The  principal  diagonal  con- 
tains ihe  cells  indicating  correct  coding;  other  cells  contain  incorrect 
coding.     The  column  totals  are  the  total  number  of  criterion  examples 
shown  on  the  videotape  for  each  code;  the  row  totals  are  the  total  num- 
ber of  times  an  observer  recorded  each  code,  whether  correctly  or  not. 
An  examination  of  a  particular  cell  reveals  whether  the  code  was  recorded 
correctly  or  incorrectly  and,  if  recorded  incorrectly,  shows  exactly 
which  codes  were  confused. 

The  total  number  of  tallies  in  each  cell  can  be  used  to  calcu- 
late the  rates  of  accuracv  in  two  related  biiL  distinct  ways.     The  first 
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Table  6 
SRI  What  AND  How  Codes 


What  Codes 


How  Codes 


2  - 

3  - 

4  - 

5  - 


1    -    Command  or  Request 
IQ    -    Direct  Question 

Open-ended  Question 
Response 

Instruct ic.i.  Explanation 

Comments ,  Greetings; 
General  ActJon 

6  -  Task-related  Statement 

7  -  Acknowledge 

8  -  Praise 

9  -  Corrective  Feedback 

10  -  No  Response 

11  -  Waiting 

12  -  Observing,  Listening 
NV  -  Noverbal 

X  -  Movement 


H  - 

U  - 

N  - 

T  - 

Q  - 

G  - 

P  - 

0  - 

W  - 

DP  - 

A  - 

B  - 


Happy 

Unhappy 

Negative 

Touch 

Quest  ion 

Guide/Reason 

Punish 

Object 

Worth 

Dramatic  Play/ 
Pretending 

Academic 

Behavior 
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columns  wore  in  the  diagonal  celJ ,  the  result  would  be  100%  correct. 
The  total  number  of  possible  examples  on  the  videotape  are  listed  on 
the  bottom  row.     For  example,  Code  IQ  was  recorded  correctly  77%  of 
the  time,  whereas  16Z  of  the  time  it  was  confused  with  Codes  1,  2,  or  3. 

Figure  14  is  an  overlay  of  Figures  12  and  13.     This  provides  the 
data  necessary  to  quickly  assess  the  observers'  accuracy  (by  looking  at 
the  topmost  entry  in  a  cell)  and  the  percent  of  criterion  codes  which 
have  been  recorded  (by  looking  at  che  lower  entry  in  a  cell). 

a.      Findings  of  What  Code  Confusions 

Since  a  What  code  is  required  for  each  interaction,  each 
recorded  frame  must  include  a  recording  of  a  What  code.     The  observer 
has  the  option  only  of  recording  the  correct  (or  criterion)  code  or  re- 
cording the  wrong  code.     The  entire  frame  is  considered  void  if  no  What 
code  is  recorded. 

In  Figure  14,  four  of  the  What  codes  have  been  separated 
into  two  categories:     the  What  code  alone  and  the  What  code  with  its 
How  modifier.     This  was  done  because  the  meaning  or  definition  of  the 
un^at  code  is  modified  or  sometimes  changed  by  the  addition  of  these 
specific  How  codes.     An  example  of  this  is  the  Code  5.     The  definition 
ol  Code  5  is  "general  comment,"  but  the  definition  of  Code  5NV  is  "gen- 
eral action." 

As  mentioned  earlier,   the  nuHiber  of  criterion  examples 
for  some  codes  is  small  which  limits  the  conclusions  that  can  be  drawn 
regarding  these  low  frequency  codes.     For  this  reason,  codes  with  five 
or  fewer  examples  on  the  videotapes  will  not  be  discussed. 

Nine  of  the  16  What  codes  have  six  or  more  criterion  ex- 
amples of  each  code.     These  are  the  shaded  diagonal  cells  in  Figure  14, 
Of  these  nine  (IQ,  "direct  question;"  3,  "response;"  4,  "instruction, 
explanation;"  4NV,  "nonverbal  instruction;"  5NV,  '  tionverbal  general  ac- 
tion or  play;"  6,  "task-related  statement;"  7,  "acknowled-ge ; "  9,  "cor- 
rective feedback;"  and  12,  "observing,  liszening"),  only  Code  6  has  an 
observer  accuracy  rate  that  is  lower  than  .70. 

Code  6,  "task-relited  statenent,"  was  confused  most  often 
with  Code  3,  "response."     It  was  also  sometimes  confused  with  examples 
which  were  actually  Code  1   ("command  or  request").  Code  2  ("open-ended 
question"),  and  Code  9  ("corrective  feedback"),  as  shown  in  Row  6.  This 
suggests  that  the  definitions  and  training  procedures  need  to  be  more 
exact  regarding  when  to  code  a  task-related  statement  as  Code  6.  The 
numbers  in  the  lower  section  of  the  cell  (Jooking  down  the  6  column)  in- 
dicate that  23%  of  the  time  the  criterion  examples  of  Code  6  were  re- 
corded as  5. 
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The  next  lowest  in  reliability  was  Code  4,  "instruction, 
explanation*"    Observers  recorded  what  should  have  been  Code  12,  "ob- 
serving, listening,"  as  Code  4  11%  of  the  time.     Since  4  is  verbal  and 
12  is  nonverbal,  the  problem  would  not  appear  to  be  one  of  confusion  of 
what  is  occurring  but,  rather,  confusion  of  which  person  to  focus  upon. 
This  conclusion  is  based  on  the  fact  that  both  of  these  codes  generally 
occur  simultaneously  (that  is,  when  a  teacher  is  instructing,  coded  4, 
the  children  are  usually  attending  or  listening,  coded  as  12),  Appar- 
ently the  observers  were  confused  as  to  which  person  to  record.    As  can 
be  seen  in  Figure  14  ,  in  the  Code  12  row,  a  true  example  of  Code  4  was 
sometimes  confused  and  recorded  as  Code  12,  which  is  a  further  indica- 
tion that  the  instructions  regarding  the  focus  of  observation  were  not 
clearly  understood  by  observers. 

Code  4NV,  "nonverbal  instruction,"  describes  a  child  in- 
structing himself.     Observers  recorded  this  reliably  88%  of ^the ''f^im'S. 
They  sometimes  confused  4NV  with  what  was  truly  a  5NV,  a  code  that  de- 
scribes "nonverbal  general  action  or  play,"    Looking  down  the  4NV  colt 
umn^  it  can  be  seen  that  15%  of  the  videotaped  examples  were  recorded 
as  5NV.     This  confusion  of  4NV  and  5NV  indicates  an  overlap  of  defini- 
tions (or  a  conceptual  difficulty  in  distinguishing  "work"  from  "play"). 

Criterion  examples  of  Code  7,  "acknowledge,"  were  some- 
times coded  as  6  or  12,     Code  7  is  sometimes  confused  with  Code  3,  "re- 
s[  ^^nse"  (see  Row  7  in  Figure  14),     It  is  easy  to  see  how  acknowledging 
a  child  can  be  confused  with  responding  to  a  child.     On  the  other  hand. 
Code  3,  "response,"  was  one  of  the  more  reliable  codes.     It  was  not  con- 
fused with  Code  7  (see  Figure  14),     In  fact,  the  observers  recorded  it 
correctly  91%  of  the  time,  and  Column  3  indicates  that  5%  of  the  crite- 
rion examples  were  coded  as  6. 

Of  the  recorded  instances  of  Code  IQ,  "direct  question," 
11%  should  have  been  Code  2,  "open-ended  question."    The  confusion  be- 
tween Codes  IQ  and  2  has  long  been  recognized  by  the  SRI  researchers. 
Each  year  the  variables  have  been  defined  more  carefully;  however,  there 
still  seems  to  be  a  gray  ar~a  of  unclarity  between  the  two  codes.  Code 
2,  which  has  too  few  examples  to  analyze  with  confidence,  was  also  con- 
fused with  IQ.     The  results  of  individual  observers  were  examined,  and 
apparently  those  observers  who  observed  classroom  models  that  do  not 
often  require  the  2  code  had  a  higher  rate  of  error. 

The  observers  recorded  9,  "corrective  feedback,"  correctly 
86%  of  the  time;  5%  of  the  time.  Code  6  was  recorded  as  9  (see  Row  9,  the 
upper  value).     The  criterion  examples,  as  illustrated  in  Column  9  (the 
lower  value)  were  sometimes  coded  as  1,  IQ,  and  6, 


b ,       Findings  for  How  Code  Confusions 

A  How  code  is  not  always  required.    This  rule  leads  to 
four  distinct  possibilities: 


ERIC 


Ik 

04 


A  required  How  was  left  out  of  the  frame  (omission), 
(These  are  listed  at  the  bottom  of  Figure  15  0 


"    ^  How  code  was  recorded  when  not  called  for  (intru- 
sion),    (These  are  listed  in  the  last  column  of  Fig- 
ure 15,) 

The  criterion  How  code  wps  confused  with  another 
code,     (These  are  entered  in  other  than  the  diagonal 
cells, ) 

-    The  criterion  How  code  was  recorded  accurately, 
(These  are  entered  in  the  diagonal  cells,) 

Only  six  of  the  14  Ho\   codes   (including  the  What  code 
modifiers,  NV  and  X)  were  represented  by  six  or  more  examples  on  the 
videotapes.     These  are  NV,  X,  A,  B,  DP,  and  0  (see  Figure  15),  (Codes 
with  five  or  fewer  examples  will  not  be  discussed,)    As  described  ear- 
lier, the  upper  value  in  a  cell  reports  the  percent  of  observer  accuracy. 
The  lower  value  in  the  cell  reports  the  percent  of  the  videotaped  ex- 
amples which  were  correctly  recorded. 

The  nonverbal  code,  NV,  was  recorded  correctly  93%  of  the 
time  by  observers;  and,  overall,  the  observers  omitted  only  13%  of  the 
criterion  examples.     Code  X,  ''movement,"  was  also  found  to  be  reasonably 
reliable.     The  observer  recorded  it  correctly  89%  of  the  time,  although 
20%  of  the  examples  were  omitted  by  observers. 

Observers  recorded  the  A  code,  "academic,"  correctly  81% 
of  the  time.     Of  the  A  codes  recorded,  4%  should  have  been  Code  B,  and 
15%  of  the  A  codes  were  actually  intrusions.    Also,  76%  of  the  video- 
taped examples  were  recorded  correctly,  and  21%  were  omitted. 

While  95%  of  the  examples  tecorded  as  Code  B  by  the  ob- 
server were  correct   (see  Row  B),  43%  of  the  B  codes  were  omitted  and 
13%  of  the  examples  of  Code  B  were  incorrectly  recorded  as  Code  A. 
This  leads  to  the  conclusion  that  if  a  B  code  is  recorded,  it  is  likely 
to  be  correct,  but  the  total  number  of  B  codes  may  be  underestimated  by 
over  50%.     An  examination  of  each  observer's  work  is  important  in  order 
to  discover  the  source  of  the  underestimation.     It  is  possible  that 
only  a  few  observers  are  grossly  underestimating  the  incidence  of  B 
codes,  or  it  could  be  that  many  of  the  63  observers  are  underestimating 
B  codes  to  only  a  small  degree. 

The  two  remaining  codes  with  six  or  more  examples  (DP, 
"dramatic  play,  pretending"  and  0,  "object")  were  recorded  accurately 
over  80%  of  the  time,  but  both  codes  were  underestimated  (43%  and  33% 
of  the  time,  respectively). 
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5 .  Summary 

The  results  of  the  conf usabil ity  study  identify  the  specific 
codos  that  appear  to  be  reliable  as  well  as  those  that  are  confused  and 
need  to  be  redefined.     The   findings  suggest  that  some  codes,  such  as 
6,  4NV,  and  5NV,  should  be  mOiTe  carefully  defined  because  of  overlapping 
definitions.     There  is  some  indication  that  there  should  be  more  i^areful 
training  of  observers  on  the  focus  of  observation  so  that  Code  A  and 
Code  12  will  not  be  confused.     The  overall  reliability  for  all  observers 
on  the  What  codes  was  78%  and  81%  for  the  How  codes. 


D •      Observer  Reliability 

1.      Accuracy  of  Individual  Observers 

The  value  of  this  new  method  for  measuring  accuracy  is  that  it 
contributes  directly  toward  interpreting  the  data.     Observer  bias  can 
be  assessed  by  examining  the  overuse,  underuse,  or  confusion  of  codes. 
In  this  study,  each  observer  was  responsible  for  observing  one  grade 
level  at  a  single  site.     Therefore,  the  data  collectad  by  each  observer 
are  identifiable  in  the  analysis. 

In  Older  to  determine  the  accuracy  rates  for  each  observer 
separately,  tables  were  constructed  that  graphically  present,  by  spon- 
sor, each  observer's  results  (see  Table  7),     Thus,  for  example,  if  an 
observer  in  Grade  1  at  Site  X  had  difficulty  with  Code  7,  "acknowledge," 
it  is  possible  to  compute  the  site  mean  of  Code  7  and  compare  it  with 
the  first  grade  means  of  Code  7  at  the  four  other  sites  of  the  sponsor. 
If  the  means  of  the  four  sites   (not  in  question)  are  similar  and  the 
mean  of  the  site  in  question  differs  from  the  other  four,  there  are 
two  possible  explanations:     (1)  Site  X  may  indeed  differ  from  the  other 
four  sites,  or  (2)  the  observer  at  Site  X  may  not  be  recording  accu- 
rately.    In  any  case,  the  data  resulting  from  Code  7  at  Si  e  X  would 
be  interpreted  with  caution.     This  procedure  allows  for  each  observer's 
data  to  be  reviewed  in  order  to  estimate  the  accuracy  of  the  individ- 
ual on  each  code  and  to  allow  for  the  data  to  be  interpreted  accord- 
ing] y. 

As  an  example.  Table  7  shows  the  observer  accuracy  rate  (the 
first  number)  and  the  criterion  accuracy  rate  (the  second  number)  for 
each  of  the  Far  West  observers  for  each  code.     In  addition,  an  overall 
accuracy  rate  for  each  observer  on  all  l^at  and  Hoi\  codes  has  been 
computed  and  displayed  on  this  table  to  provir^e  a  general  idea  of  the 
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observer's  skill.''-    Tho  results  are  grouped  by  grade  level  and  site. 
Similar  tables  lor  the  other  six  sponsors  in  the  evaluation  were  pre- 
pared (see  Appendix  L) .     The  complete  conf usability  matrix  of  all  ob- 
servers is  not  included  in  tLis  report  but  is  available  at  SRI. 

As  indicated  earlier,  five  or  fewer  criterion  examples  ol  a 
code  minimize  the  confidence  with  which  the  actual  results  can  be  uti- 
lised.    Therefore,  only  codes  with  six  or  more  examples  are  considered 
in  the  analysis  of  specific  grade  levels  within  a  site. 

As  an  13 lusl ration  of  how  Table  7  can  be  used,  the  results 
of  the  first  observers  listed  are  discussed.     The  observers  are  grouped 
according  to  the  site  or  project  they  observed.     Going  from  left  to 
right,  the  l^at  codes  are  first  shown  on  the  extreme  left  with  the 
codes  which  are  represented  by  six  or  more  criterion  instances.  The 
next  section  includes  the  What  codes  that  were  represented  by  five 
or  fewer  instances.     The  How  codes  are  shown  next,  with  a  similar 
d  ivi  sion. 


a .       Findings  from  What  Codes  Occurring  Six  or  More  Times 

The  first  observer  listed.  Observer  for  Grade  1  from 
Berkeley  had  an  overall  reliability  rate  of  .84  on  the  What  codes 
(see  Table  7).     Of  the  nine  codes  with  six  or  more  criterion  instances, 
only  two  codes  registered  an  observer  accuracy  or  criterion  accuracy 
rate  of  less  than  ,75.     Looking  at  Code  4,  "instruction,  explanation," 
we  see  an  observer  accuracy  rate  of  .62  and  a  criterion  accuracy  rate 
of  .89.     This  means  that  when  Observer  for  Grade  1  recorded  Code  4,  it 
was  correct  62%  of  the  time.     The  observer  actually  recorded  a  Code  4 
some  89%  of  the  time;  thus,  she  missed  only  11%  of  the  examples.  How- 
ever ,  38%  of  the  time  when  she  recorded  4  codes  she  was  incorrect. 
Therefore,  variables  using  the  4  code  in  the  first  grade  at  Berkeley 
should  be  interpreted  with  caution. 

The  other  code  which  the  observer's  results  show  to  be 
considered  less  than  adequate  was  the  5NV  code,  "nonverbal  general  ac- 
tion or  play."     The  observer  accuracy  rate  of  1.00  shows  that  wher.  she 
recorded  a  5NV  it  was  always  a  5NV — she  did  not  confuse  it.  However, 
she  failed  to  code  50%  of  the  videotape  examples  of  5NV. 


-'-The  overall  accuracy  rate  is  arrived  at  by  computing  the  ratio  of  cor- 
rect recordings  (those  that  fall  in  the  diagonal  cells)  of  all  codes 
to  the  total  number  of  recorded  codes  and  to  the  total  number  of  crite- 
rion instances  of  the  codes.     For  the  U^iat  codes,  the  two  ratios  are 
the  same  since  the  total  number  of  recorded  codes  is  equal  to  the  total 
number  of  criterion  instances.     Two  ratios  are  required  for  the  How 
codes  since  observers  are  not  required  to  record  a  How  code  in  each 
frame  which  leads  to  differences  between  the  total  numbers  of  criterion 
examples  and  total  numbers  of  recorded  codes. 
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The  overall  results  for  Observer  for  Grade  1  show  that 
the  observation  data  she  gathered  can  be  analyzed  with  a  great  deal  of 
confidence.     Only  the  results  for  the  4  and  3NV  codes  must  be  analyzed 
with  special  caution. 

Three  of  the  other  first  grade  observers  for  this  sponsor 
registered  observer  accuracy  rates  of  over  .70  on  the  4  code.     The  first 
grade  observer  at  Tacoma  has  an  observer  accuracy  i  *  e  of  only    54.  If 
the  results  of  the  data  collection  show  that  Grade  1  at  Berkeley  and 
Tacoma  have  means  and  standard  deviations  for  Code  4  that  differ  widely 
from  those  at  the  other  sites,  it  may  be  explained  by  the  observers' 
confusion  in  the  use  of  the  4  code. 

A  similar  situation  exists  with  the  data  for  three  of  the 
four  other  first-grade  observers  on  the  videotape  examples  of  the  5NV 
code.    The  underestimation  of  the  code  by  Observer  for  Grade  1  at  Berke- 
ley is  not  common  to  all  first  grade  observers.    Therefore,  this  should 
be  taken  into  consideration  when  the  data  are  analyzed. 

b.  Findings  from  How  Codes  Occurring  Six  or  More  Times 

It  can  be  seen  on  Table  7   that  Observer  for  Grade  1  at 
Berkeley  was  100%  accurate  when  she  recorded  five  of  the  more  frequent 
How  codes.     The  one  coding  exception  is  A,  "acadeinic . Only  67%  of 
the  time  were  her  A  codings  correct;  33%  of  the  time  they  should  not 
have  been  coded  as  A.     However,  she  recorded  90%  of  the  occurrences  of 
Code  A  on  the  videotape.    The  extra  33%  that  she  recorded  are  considered 
intrusions,*  and  they  overestimate  the  occurrence  of  this  code.  Ob- 
servers at  other  sites  had  their  own  specific  difficulties,  and  their 
data  will  have  to  be  analyzed  in  the  same  way  that  the  data  of  Observer 
for  Grade  1  at  Berkeley  have  been  analyzed. 

c .  Summary 

The  usefulness  of  this  method  of  measuring  the  accuracy 
of  individual  observers  lies  in  its  capacity  to; 

-  Differentiate  codes  according  to  relatively  high  or 
low  levels  of  confidence; 

-  Assess  an  individual's  coding  skill  on  a  specific 
code  and  examine  observer  bias; 

Compare  individual  observer's  scores  with  other  ob- 
server's scores  at  the  sponsor's  same  grade  level. 


See  page  75  for  an  explanation  of  intrusion. 
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By  thus  identifying  the  various  sources  of  error  in  the 
observation  measures,  we  can  more  accurately  determine  whether  specific 
problems  lie  in  the  code  itself  or  with  the  individual  observer  and  thus 
interpret  the  data  <iccording  to  observer  bias. 


2,      A  Study  Comparing  Accuracy  Between  Observers  and  Videotape 
Simulation  Accuracy 

The  preceding  section  has  examined  the  conf r.sability  of  the 
observation  codes  and  the  ability  of  observers  to  code  criterion  video- 
tap^es.     Videotaped  simulation  of  classroom  events  are,  admittedly,  dif- 
ferent from  actual  classroom  events*     In  an  effort  to  compare  the  ac- 
curacy of  observer  ratings  on  the  simulations  and  accuracy  between  raters 
in  classrooms,  a  small  study  was  conducted  in  one  location.     This  section 
compares  the  results  obtained  from  both  studies  of  accuracy  for  two  ob- 
servers . 


a.      Paired  Observers 

The  first  method,  the  paired  observation,  is  the  most 
commonly  used  method  of  assessing  interaction  analysis  instruments* 
The  procedure  followed  is  to  have  the  two  observers  (generally  a  trainer 
and  qualified  observer)  situated  in  the  same  classroom,  coding  exactly 
the  same  situation  simultaneously*     The  recorded  codes  are  then  evalu- 
ated in  terms  of  percent  agreement  betwean  the  two  observers*  Since 
the  speed  of  the  two  observers  is  not  expected  to  be  consistent,  the 
ratio  of  the  number  of  codes  recorded  by  the  observer  is  compared  to 
the  ratio  of  the  number  of  codes  recorded  by  the  trainer* 

It  must  be  pointed  out  that  this  paired  observation  pro- 
cedure has  some  serious  limitations.     First,  two  extra  people  in  the 
classroom  are  more  obtrusive  than  one.     Second,  it  is  almost  impossible 
to  assure  that  the  two  observers  are  focusing  on  exactly  the  same  ac- 
tion.    Due  to  limited  space,   the  two  observers  may  not  have  the  same 
angle  of  observation;   thus,  what  they  see  and  hear  may  be  somewhat  dif- 
ferent and  yet  each  observer  could  be  collecting  a  correct  and  adequate 
sample  of  the  behavior  chat  is  occurring*    A  third  problem  is  that  even 
if  the  marginal  frequency  counts  of  a  code  by  two  observers  are  numer- 
ically similar,  we  cannot  be  certain  that  the  two  observers  have  recorded 
specific  incidents  exactly  the  same*     Similar  ratios  could  occur  by 
chance.     Pinally,  it  happens  that  during  the  clasirroom  observations 
certain  interactions  or  codes  do  not  occur,  or  occur  at  such  a  minimal 
rate  that  reliability  cannot  be  computed*    There  is  no  way  to  be  cer- 
tain that  all  codes  will  be  assessed  within  a  given  time  period* 

In  this  study,  data  from  sixteen  5-minute  observations 
were  examined,  using  three  Who  codes,  twelve  What  codes,  and  thirteen 
How  codes.     (Codes  Q  and  P  were  excluded  because  each  occurred  only 
once*)     Two  different  observers  (referred  to  as  Observer  1  and  Observer 
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2)  were  analyzed.     Tp  assess  the  coding  accu?.acy  of  the  two  observers, 
the  proportion  of  frames  that  contained  a  particular  code  was  recorded 
for  each  trainer  and  observer.     From  the  proportions,  the  following  equa- 
tion was  computed  for  each  code  (z  is  for  the  trainer  and  y  is  for  a 
given  observer  on  a  given  code) : 

The  percent  agreement  =  100  x  ^.^^  ..^y^  ^l"^' 

max  (y,  z) 

Tables  8  and  9    show  the  overall  percentage  reliability 
of  the  codes  separately,  in  terms  of  their  ratio  of  frequency.  It 
must  be  noted  that  accuracy  for  low-frequency  variables  is  difficult 
to  interpret  because  if  the  trainer  records  an  event  four  times  and  the 
observer  only  two  times  and  they  observe  an  equal  number  of  frames,  the 
agreement  is  only  50%,  even  though  the  actual  difference  is  only  two 
occurrences.     Higher-frequency  variables  can  tolerate  a  difference  of 
two  occurrences  and  still  show  a  high  percentage  of  agreement.     The  data 
for  each  observer  are  presented  separately  in  Tables  8  and  9  .  Since 
there  are  sixteen  paired  observations,  it  is  possible  to  have  as  many 
as  1,216  frames  of  interaction.    Therefore,  we  have  separated  the  data 
into  three  categories:     least  frequent,  moderately  trequent,  and  most 
frequent.    Table  10  is  included  to  further  clarify  the  results  of  the 
paired  observations.     It  includes  the  frequency  scores  of  the  SRI 
trainer  as  well  as  the  ratios  of  occurrence  and  percent  agreement  scores 
for  both  observers  over  all  codes. 

The  results  show  that  both  of  the  observers  were  very  re- 
liable on  the  IVho  codes.     The  What  codes  were  also  recorded  very  re- 
liably, with  only  two  exceptions.     Observer  1  recorded  less  than  half 
as  many  8  codes,  "praise,**  as  the  trainer,  and  Observer  2  massed  nearly 
80%  of  the  occurrences  of  Code  6,  **task-related  statement.**  Signifi- 
cantly, however,  both  of  these  codes  occurred  with  low  frequency. 

The  results  on  the  How  codes  were  much  lower.  Observer 
1  was  quite  reliable  on  the  NV,  **nonverbal, **  G,  **guide  to  alternative,** 
A,  **academic,**  and  B,  **behavior**  codes.     She  was  below  the  50%  agree- 
ment rate  for  the  X,  **movement,**  H,  "happy,**  N,  **negative ,**  and  0,  **ob- 
ject**  codes.     The  remaining  codes  occurred  less  than  ten  times  accCi.uing 
to  the  *:rainer's  score  and,  therefore,  nc  accuracy  rate  could  be  ar- 
rived at. 

Observer  2's  rate  of  accuracy  was  similar  on  the  How 
codes.     She  was  reliable  on  the  NV,  X,  and  A  codes  and  below  the  50% 
level  on  the  Q,  G,  H,  and  B  codes.     Seven  of  the  How  codes  occurred 


*Whea  z  ~  0  and  y  =  0,  the  percent  agreement  is  assigned  a  value  of  100. 
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Table  8 


PERCENT  AGREEMENT  BETWEEN  TRAINER  .\ND  OBSERVER  1 


A.        Who  Codes 

Percent  Least  Frequent  Moderately  Frequent  Most  Frequent  Total  No. 
Agreement    (0-60)  (61-175)   (176-1,216)      of  Codes 


91-100  Adult,  Child  2 

81-90  Machine  1 

71-80  0 

61-70  0 

51-60  0 

41-30   0 

Total  3 


B.      What:  Codes 


Percent  Least  Frequent  Moderately  Frequent  Most  Frequent  Total  No. 
Agreement  (0-60)  (61-175)   (176-1,216)      of  Codes 


91-100  10  4  2 

81-90  IQ,  6  1,  3,  12  5 

71-80  11  1 

61-70  5,  9  2 

51-60  7  1 

41-50  8  _1 

Total  12 


C.      How  Codes 

Percent  Least  Frequent  Moderately  Frequent  Most  Frequent  Total  No. 
Agreement  (0-60)  (61-175)   (176-1,216)      of  Codes 


91-100 

U,  G,  DP 

A 

4 

81-90 

0 

71-80 

NV 

1 

61-70 

15 

1 

51-60 

0 

41-50 

X 

1 

31-40 

T 

1 

21-30 

0 

11-20 

Q 

H 

2 

0-10 

N,  0,  W 

3 

Total  13 
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Table  9 


PERCENT  AGREEMENT  BETWEEN  TRAINER  AND  OBSERVER  2 


A.      1^10  Codes 


Psrcent 
Agreement 

91-100 
81-90 

n-so 

■,1-70 
51-60 
41-50 


Least  Frequent 
(0-60) 


Moderately  Frequent 
(61-175)  


Most  Frequent 
(176-1,216) 

Adult,  Child 


Total  No. 
of  Codes 

2 
0 
0 
0 

0 


Total 


B. 


What  Codes 


Percent 
Agreement 

91-]00 

81-90 

71-80 

61-70 

51-60 

41-50 

31-40 

21-30 

11-20 


Least  Frequent    Moderately  Frequent    Mosu  Frequent    Total  No. 
(0-60)  (61-175)   (176-1,216)      of  Codes 


8 


10 


^,  7 


5 
3 

IQ 
12 
1 


Total 


2 
1 
3 

L 

2 
0 
0 
0 

1 
11 


C«      How  Codes 

Percent  Least  Frequent  Moderately  Frequent  Mc^t  Frequent  Total  No. 
Agreement  (0-60)_  (61-175)   ('76-1,216)      of  Codes 


91-100 

DP 

A 

2 

81-90 

0 

71-80 

NV 

1 

61-70 

0 

51-60 

X 

1 

41-50 

0 

31-40 

T 

I 

21-30 

H,  U,  Q,  G 

4 

11-20 

B 

1 

0-10 

N,  0,  W 

Total 

3 
13 
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RLSl'IJS  OF  PAIRED  OHS!,RVA'UONb 

 Obsoiver  I    Observer  2  

Percent  Observer  Trainer  Trainer  Percent  Observer  Trainer  Trainer 
Agreement      Ra t  i o          Ra^io      ^cor_^e_   Agreement      Ra t  i o  Rat  io  Score 


Who  Codes 


Adult 

97/. 

.482 

.467 

502 

94/ 

.544 

.573 

638 

Child 

96 

.488 

.  SU6 

544 

98 

.431 

.423 

467 

Machine 

Q  0 

Ow 

.  u  zo 

.  uuu 

0* 

(lota! 

t  requeue V 

1  ,  160 

1  ,076 

1 ,076  ) 

990 

1,105 

1  ,10^ 

.'h^r  Code 

: 

L 

88^. 

.  171 

.150 

161 

60/ 

.174 

.104 

115 

IQ 

90 

.103 

.09  3 

100 

73 

.  106 

.14  5 

160 

2 

.000 

.001 

1* 

—  * 

.001 

.000 

0* 

3 

88 

.212 

.242 

260 

89 

.288 

.257 

283 

99 

.150 

.  151 

162 

77 

.091 

.070 

77 

5 

65 

.086 

.056 

60 

92 

.091 

.099 

109 

6 

.069 

.056 

60 

17* 

.006 

.035 

38: 

7 

56 

.020 

.036 

38* 

75* 

.0  39 

.052 

57 

8 

.007 

.016 

17* 

100* 

.022 

.022 

24* 

9 

.042 

.065 

55 

.038 

.069 

76 

10 

93 

.013 

.014 

15 

65 

.031 

.020 

22* 

11 

75* 

.003 

.004 

4^ 

 A 

.020 

.000 

0* 

12 

83 

.  121 

.100 

107 

70 

.087 

.124 

137 

NV 

73;^ 

.2  39 

.174 

187 

717. 

.144 

'.203 

224 

X 

^♦3 

.053 

.023 

23* 

51* 

.021 

.041 

45* 

low  Codes 

K 

11 

.006 

.057 

61 

22* 

.004 

.018 

20* 

U 

100* 

.000 

.000 

0* 

25* 

.016 

.004 

4* 

N 

8* 

.001 

.012 

13* 

0* 

.000 

.009 

10* 

T 

33* 

.003 

.009 

9* 

33* 

.003 

.009 

9* 

Q 

11* 

.001 

.009 

9* 

2  3* 

.005 

.022 

24* 

G 

100* 

.033 

.033 

35* 

.008 

.028 

31.: 

P 

.000 

.001 

1* 

.002 

.000 

0 

0 

.000 

.016 

17* 

.000 

.001 

1* 

W 

0* 

.000 

.007 

7* 

 * 

.000 

.002 

2-* 

DP 

100* 

.000 

.000 

0* 

100* 

.000 

.000 

0* 

A 

94 

.760 

.713 

767 

93 

.670 

.622 

687 

B 

62* 

.018 

.029 

31* 

16* 

.008 

.051 

56* 

Note:     Ratio  here  means  the  occurrence  of  a  specific  code  divided  by  the  total  number 
of  frames  recorded. 

Fewer  than  60  criterion  instances. 
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only  ten  or  fewer  Limes,  thu^  generalizations  regarding  these  codes 
would  be  made  with  caution,'^ 

^ •      Videotaped  Skits  (Simulations) 

The  second  phase  of  che  reliability  study  was  based  on 
the  previously  described  videotaped  skits*    The  same  proceiure  was  fol- 
lowed, having  the  two  observers  code  interactions  seen  on  the  videotape 
and  comparing  that  record  with  the  predetermined  criteria.     The  tape 
has  stops  or  pauses  between  each  interaction  to  ensure  that  each  ob- 
server knows  which  interaction  to  code.    The  procedures  are  repeated 
here  for  purposes  of  clarification. 

The  results  were  compiled  for  both  observers.    They  re- 
veal both  (1)  which  occurrences  were  not  recorded,  and  (2)  which  codes 
were  erroneously  recorded.     The  procedure  allowed  us  to  identify  the 
problem  codes  for  each  specific  observer. 

In  the  figures  that  follow,  two  values  are  shown  in  each 
cell.     For  those  cells  that  fall  on  the  main  diagonal,  the  upper  value 
shows  the  percent  of  times  the  total  number  of  codes  recorded  was  cor- 
rect.    The  lower  value  shows  the  percent  of  times  the  code  actually  oc- 
curred and  was  recorded  correctly  by  the  observer. 

For  cells  that  do  not  fall  on  the  diagonal,   the  two 
values  indicate  proportions  of  error  rather  than  of  accuracy.     The  upper 
value  shows  the  percent  of  times  a  specific  code  (as  shown  by  row  indi- 
cator) was  recorded  instead  of  a  specific  criterion  code  (indicated  by 
the  column)  to  the  total  number  of  recordings  of  that  code.     The  lower 
value  indicates  the  percent  of  t^'mes  that  the  specific  code  (indicated 
by  the  row)  was  recorded  when  a  given  criterion  code  was  called  for 
(shown  by  the  column) . 

Figures  16-19  are  matrices  showing  the  percent  of  accu- 
racy and  the  percent  of  the  total  codes  recorded  for  the  two  observers. 
Computations  are  for  the  What  and  the  How  codes.     Thi  total  number 
of  criterion  instances  of  each  code  is  shown  at  the  bottom  of  each  col- 
umn.    The  total  number  thaL  the  observer  recorded  is  given  at  the  end 
of  each  row. 

Those  codes  that  occurred  five  or  fewer  times  are  listed 
in  the  matrices  but  will  not  be  discussed  in  the  body  of  this  text.  A 
decision  was  made  that,  in  these  cases,  the  confidence  level  with  which 


*This  study  of  inter-rater  reliability  would  be  more  useful  if  it  had 
also  examined  the  day-to-day  variability  of  the  classroom  so  that  the 
error  due  to  observers  and  the  error  due  to  varying  classroom  pro- 
cesses could  have  been  computed. 
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we  nii^lit  mako  prt'dictions  as  to  the  reliability  of  an  observer  woaid  be 
so  low  as  Lo  render  ic  unacceptable.     Therefore,  only  the  codes  which 
were  test<.'d  by  six  or  more  criterion  examples  will  be  considered  in  this 
ana J  ysis . 

As  shown  in  Figure  16,   the  What  matrix  for  Observer  i  in- 
dicates that,  of  the  nine  codes  that  included  six  or  mure  criterion  in- 
stances, only  the  4NV  code,   "nonverbal  instruction,"  the  5NV  code,  "non- 
verbal general  action  or  play,"  and  the  6  code-^  "task-related  statement" 
had  a  criterion  accuracy  lower  than  .70.     In  the  6  code,  80%  of  the  re- 
corded 6  codes  were  correct,  but  69%  of  the  criterion  codes  were  missed. 
Moving  up  the  6  column  we  can  see  that  5A%  of  the  criterion  6  codes  were 
incorrectly  coded  as  5.     The  problem  with  the  5NV  code  is  somewhat  dif- 
ferent.    In  this  case  the  problem  is  that  both  the  criterion  rate  and 
the  observer  correctness  were  low.     It  appears  that  on  the  simulations 
Observer  I  had  difficulty  distinguishing  the  5NV  code  from  the  4NV,  "non- 
verbal instruction"  code,  since  she  often  cod-^'i  the  criterion  ANV  in- 
stances as  5NV  and  also  the  5NV  criterion  as  ANV. 

Over  all  Wha t  codes.  Observer  1  is  reasonably  accurate 
with  a  criterion  rate  of  .76  which  is  average  for  all  63  observers  ex- 
amined by  the  videotapes  on  the  What  codes. 

Observer  2  had  a  reasonable  overall  criterion  accuracy 
rate  (.70)  also,  but  she  had  coding  probl^.ms  with  several  codes  (see 
Figure  17).     She  did  not  record  the  A  code,  "instruction,  explanation" 
567  of  the  time.     The  4NV,  6,  7,  and  9  codes  were  also  coded  less  fre- 
quently tl an  required.     She  used  the  12  code,  "observing,  listening" 
eight  more  times  than  required,  where  she  should  have  used  codes  3,  4, 
and  7 . 

The  How  code  accuracy  for  Observer  1  was  also  acceptable 
(see  Figure  18).     Her  overall  criterion  accuracy  rate  was  .78.  This 
figure  indicates  that  of  the  111  criterion  How  codes  presented,  she 
recorded  87  correctly  (see  lower  right-hand  corner  of  Figure  18).  The 
only  How  code  that  Observer  1  recorded  with  less  than  70%  accuracy  was 
the  0  code,  "object;"  50%  were  missed  and  64%  were  recorded  when  not 
indicated.     The  other  codes  that  lell  below  a  .70  rate  of  accuracy  were 
codes  that  included  five  or  fewer  criterion  instances. 

Observer  2  had  a  more  difficult  time  recording  the  How 
codes  from  the  tapes.     In  Figure  19  her  t verall  accuracy  rate  is  shown 
as  only  .56.     On  individual  codes,  the  0  was  very  reliable  (1.00/. 86), 
but  the  NV  was  not  used  41^^  of  the  times  when  it  should  have  been.  The 
A,  "academic"  was  coded  when  not  called  for  sixteen  times  and  omitted 


*This  figure  is  computed  by  dividing  the  total  number  of  correct  entries 
by  the  exact  number  of  videotaped  criterion  examples. 
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eight  times  when  it  should  have  been  coded.  Codes  Bj  "behavior"  and 
DP,  "dramatic  play,  pretending"  were  ignored  compJetely. 


c.  Summary 

Two  distinct  procedures,  the  videotaped  skits  and  the 
paired  observations,  were  used  to  assess  the  accuracy  of  two  observers. 
The  results  indicate  average  reliability  for  both  observers  on  the  What 
code  category.     For  the  Kow  category.  Observer  1  is  above  average,  but 
Observer  2  is  below  the  average  of  the  other  62  observers. 

Specifically,  Observer  1  was  acceptably  accurate  on  the 
more  frequently  used  individual  codes.     Many  of  her  codes,  such  as  IQ, 
3,  4,  7,  9,  12,  NV,  A,  and  B  were  shown  to  be  very  reliable  on  botn  pro- 
cedures.    Only  Code  0,  "objects"  was  shown  to  be  unreliable  on  both 
procedures. 

The  results  were  equally  good  for  Observer  2  on  the  What 
codes  with  only  Code  6,  "task-related  statement"  being  shown  to  be  un- 
reliable on  both  procedures.     The  How  Code  B,  "behavior"  was  also 
recorded  poorly  in  both  procedures.     In  the  case  of  the  videotape  cod- 
ings. Observer  2  missed  the  13  examples  of  Code  B  and  underestimated 
it  in  the  paired  observations.     On  Code        "academic,"  Observer  2  was 
93%  accurate  ^^n  the  paired  observations  bVt  had  a  .63/. 77  reliability 
on  the  videotapes.     Other  How  codes  such  as  "movement"  and  "object" 
are  acceptably  accurate  on  the  videotapes  while  "nonverbal"  is  accept- 
ably accurate  on  the  paired  observations.     "Guide"  and  "question,"  which 
were  underestimated  in  the  paired  observer  analysis,  have  too  few  ex- 
amples on  the  videotape  to  be  discussed  in  terms  of  reliability. 

While  simulated  videotaped  events  are  limited  in  their 
scope  and  differ  from  the  classroom  situation,  they  do  o^^er  a  standard 
stimulus  to  examine  each  obsf^rv^er's  ability  to  code  specified  events 
and  to  identify  observer  bias.     There  is  still  some  confounding  in  the 
source  of  system  error;  however,  the  variation  introduced  by  a  second 
observer  is  eliminated.     While  the  two  systems  of  examining  observer 
accuracy  do  yield  some  different  information,  it  is  not  contradictory, 
and  the  videotape  system  is  far  easier  to  control  and  interpret. 

E.  Conclusions 

The  study  indicates  that  the  observation  data  collection  was  rea- 
sonably uniform.  Unacceptable  data  (e.g.,  anomalous  classroom  events, 
or  FMOs  with  too  few  interaction  frames)  were  discarded. 

Day-to-day  classroom  procedures  appear  to  be  stable  enough  to 
support  the  analysis  used  in  this  report.    When  all  classrooms  were 
combined  and  Day  1  was  compared  with  Day  2,  only  one  variable  in  the 
third  grade  fell  below  .70  reliability.     This  was  the  occurrence  of 
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Variable  66.  (Numbero,  math,  arithmetic).     The  stability  of  the  means  of 
all  classrooms  is  important  to  the  partial  correlation  and  regression 
analysis  presented  in  Chapter  VII  since  all  classrooius  are  used  to  in- 
vestigate the  relationship  of  instructional  processes  and  child  outcomes. 
Of  the  140  coefficients  that  were  computed  for  individual  sponsors,  ap- 
proximately 84%  had  a  value  of  .70  or  more.     High/Scope  had  the  least 
variability  of  all  sponsors  while  University  of  Kansas  had  reliability 
lower  than  .70  on  more  variables  than  other  sponsors.    Counter  to  common 
belief  the  more  structured  models  were  not  more  stable  in  classroom  pro- 
cesses from  Day  1  to  Day  2.     Each  sponsor  had  some  variables  which  are 
not  stable  and  interpretation  ofc  such  variables  that  are  critical  to  im- 
plementation should  be  interpreted  with  consideration  of  the  instability. 

While  there  appears  to  be  an  overlap  in  the  definition  of  some  codes, 
the  source  of  unreliability  can  be  isolated  to  a  pai;'ticular  observer. 
Hence,  data  has  been  interpreted  with  the  observer's  limitation  in  raind.* 
IvTien  coding  the  videotapes,  the  overall  reliability  for  all  observers 
was  .78  on  the  What  codes,  and  .81  on  the  How  codes  recorded.**  How- 
ever, as  previously  stated  this  method  of  assessing  reliability  is  lim- 
ited.    A  carefully  designed  study  of  observer  reliability  is  needed  where 
several  pairs  of  observers  code  in  classrooms  on  different  days  to  examine 
what  portion  of  the  error  is  due  to  observer  bias  and  what  portion  is  due 
to  day-to-day  variability  within  classroom  processes  themselves.  From 
such  a  study  we  might  be  able  to  learn  how  many  observations  are  needed 
in  a  classroom  to  obtain  a  reliable  description  of  the  procedures. 


^Interpretation  of  each  observer's  effect  upon  the  data  ccllected  is  re- 
ported at  the  end  of  each  sponsor's  section  in  Chapter  V. 

**Six  of  the  15  What  codes  and  eight  out  of  14  How  codes  were  not  in- 
cluded in  this  analysis  because  there  were,  too  few  examples  on  the 
videotaped  simulations. 
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Chapter  V 


ASSFISSMKNT  OF  iMPLEi^^U^NTAT  ION 


The  purpose  of  Chapter  V  is  to  assess  the  degree  of  implementation 
of  seven  sponsors.     The  study  of  implementation  compares  observed  class- 
room processes  with  specific  sponsor  goals.    No  cu.npletely  satisfactory 
way  to  approach  this  issue  has  presented  itself,  since  the  Follow  Through 
programs  were  not  originally  operationalized  in  terms  of  variables  de- 
fined on  SRl's  classroom  observation  schedule.     This  problem  has  been 
partially  overcome  by  constant  consultation  with  the  program's  sponsors 
during  the  creation  of  the  variables.    Also,  each  sponsor  selected  his 
o\m  set  of  variables  which  will  reflect  some  of  the  critical  components 
of  his  model.     Implementation  will  be  judged  by  "two  criteria:     (1)  the 
uniformity  of  sponsor  classroom  scores  on  selected  implementation  vari- 
ables and  (2)  how  the  sponsor  classrooms  differ  from  Non-Follow  Through 
classrooms  on  these  variables.     The  rationale  for  the  second  criterion 
is  that  Follow  Through  is  intended  to  be  an  intervention  program  that 
offers  alternatives  to  the  conventional  classroom.     The  primary  focus  on 
evaluating  program  implementation,  then,  should  be  on  those  essential 
components  of  each  sponsor's  model  that  differentiate  that  sponsor  from 
the  conventional  classroom. 

Admittedly,  important  dimensions  of  classroom  implementation  have 
not  been  liecorded.     For  example,  it  is  a  goal  for  Far  West  Laboratory  to 
have  their  teachers  establish  environments  where  a  child  can  search  for 
solutions  to  his  problems  in  his  own  way  and  can  risk,  guess  and  make 
discoveries  without  serious  negative  psychological  consequences;  however, 
we  cannot  record  whether  such  environments  have  been  established  or 
whether  children  are  solving  problems.     We  can  only  record  that  children 
engage  in  activities  independently,  work  with  a  variety  of  materials 
and  ask  questions.     Nevertheless,  past  observation  analysis  of  the  Fol- 
low Through  programs  have  been  able  to  discriminate  between  programs  and 
have  indicated  that  the  sponsors  have  been  successful  in  training  teachers 
and  aides  to  observably  perform  as  the  sponsor  desired  (Stallings,  Baker, 
Steinmetz,  1972;  Stallings,  1973). 

Successful  implementation  of  a  program  is  also  affected  by  the  com- 
munity, school  officials,  parents,  and  teachers.     If  any  of  these  partic- 
ipants have  a  reluctant  or  negative  attitude  toward  Follow  Through'  in 
general  or  a  model  in  particular,   the  level  of  implementation  is  affected. 
Although  an  assessment  of  teacher  attitudes  toward  the  model  is  used  in 
this  analysis,  systematic  information  regarding  the  other  sources  of  im- 
plementation variance,  such  as  the  community  attitude,  is  not  available. 
This  evaluation  concerns  only  what  happened  in  the  classroom. 
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A.  Methods 


1,      Preliminary  Analysis — Relationship  of  Entering  Characteristics 
and  Process  Variables 

In  this  analysis,  observational  variables  describing  classroom 
control  systems  and  adult  display  of  affect  were  related  to  entering 
characteristics  of  children  such  as  sex,  ethnicity,  and  baseline  test 
scores  of  children.     Classroom  means  were  compared  to  see  how  differ- 
ently teachers  may  behave  in  classrooms  where,  for  example,  there  are 
incre  boys  than  girls.     The  classroom  was  used  as  the  unit  of  analysis 
and  the  analysis  was  carried  out  separately  for  each  sponsor  and  for  the 
pooled  Non-Follow  Through  sample.     Only  first  grade  classrooms  were  ex- 
amined.    Correlation  coefficients  were  computed  between  classroom  pro- 
cesses and  relatively  continuous  demographic  variables;  and  analyses  of 
variance  were  performed  on  classroom  processes  for  groupings  of  class- 
rooms partitioned  on  the  basis  of  more  discrete  demographic  variables. 
Scatter  plots  of  classroom  scores  on  selected  variables  were  also  ob- 
tained to  detect  "outlying"  classrooms  and  assist  in  interpretation  of 
results.     The  overall  conclusion  from  this  analysis  is  that  teachers 
for  the  most  part  treat  classrooms  with  dissimilar  characteristics  very 
much  the  same.     Six  variables  representing  negative,  unhappy,  or  punish- 
ing behavior  on  the  part  of  adults  had  only  two  significant  correlations 
In  the  combined  seven  models.     Out  of  the  42  possible  correlations  these 
two  could  have  occurred  by  chance.     Appendix  B  presents  these  findings. 


2.      Assessment  of  Implementation 

The  results  for  each  sponsor  are  presented  in  a  separate  sec- 
tion.    Each  section  includes  the  following: 

a.      Description  of  the  Models 

The  first  step  towards  assessing  implementation  was  to 
describe  in  d  tail  each  educational  model.     These  model  descriptions 
were  approved  by  each  sponsor.     Components  which  can  be  assessed  by  the 
SRI  observation  instruments,  such  as  environment,  activities,  and  inter- 
action, have  been  identified  and  are  described  for  each  model.* 


b.      Site  DenoRraphics 

Eacli  site  for  each  sponsor  is  described  deraographically 
so  the  context  of  data  collection  is  clear.    Because  the  demographic 


*For  other  descriptions  of  the  models  see  Maccoby  &  Zellner  (1970)  and 
Weber  (1970). 
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tables  are  used  only  ciescriptively ,  statistical  tests  of  differences 
are  not  computed.     The  tables  are  presented  in  each  sponsor  section* 

c.      Designation  of  the  Sponsor  implementation  Variables 

From  the  several  sections  of  the  Classroom  Observation 
Instrument,  a  list  of  variables  intended  to  describe  representative 
classroom  elements  was  constructed  by  SRI  staff  for  each  sponsor^s  model. 
A  Sponsor  Variable  Questionnaire  was  then  compiled  and  sent  to  the  in- 
dividual sponsors  for  corrections,  deletions,  and  additions* 

What  would  be  desirable  for  a  closely  controlled  experiment 
would  be  an  explicit  statement  by  the  sponsors  of  what  proportion  of  the 
time  critical  variables  would  occur  in  an  ideally  implemented  classroom* 
However,  elements  in  a  classroom  are  not  like  those  in  a  test  tube.  We 
have  not  yet  learned  to  predict  the  amount  of  individualized  attention, 
or  feedback  that  a  group  of  children  need  to  meet  specific  goals.  Each 
classroom  group  is  made  up  of  individuals,  and  individuals  are  most  likely 
to  need  different  rates  of  feedback  or  individualized  instruction  for 
maximum  growth.     Thus,  even  the  most  specific  models  such  as  University 
of  Oregon  and  University  of  Kansas  will  alter  the  rate  of  reinforcement 
depending  upon  the  need  of  the  child.     In  the  spring  of  1973,  the  author 
(J.  Stallings)  visited  ideal  first  and  third  grade  classrooms  specified 
by  each  sponsor.     Although  each  teacher  was  an  excellent  ex-^mple  of  the 
model,  no  sponsor  was  willing  ultimately  to  suggest  that  all  other  first 
and  third  grade  teachers  should  perform  exactly  like  the  one  selected  as 
the  criterion.     For  instance,  in  East  St.  Louis  in  a  University  of  Oregon 
first  grade,  the  class  spent  the  opening  session  enthusiastically  discuss- 
ing the  movie  Sounder  which  the  children  had  seen  on  the  previous  day. 
The  teacher  was  asking  such  questions  as  ''How  did  you  feel  when  the  dog 
was  shot?"  and  "Which  of  the  people  in  the  movie  did  you  like  best?  Do 
you  know  anyone  like  those  people?"    A  whole  series  of  open-ended  questions 
(coded  as  2  on  our  observation  instrument)  were  asked.     The  children 
responded  and  extended  their  responses.     While  this  kind  of  discussion 
may  occur  within  the  University  of  Oregon  model,  the  process  is  not  part 
of  the  model  specifications.     Thus,   it  would  seem  unfair  to  use  this 
classroom  as  a  criterion  against  which  to  judge  all  other  University 
of  Oregon  classrooms,  even  though  the  adults  were  clearly  competent  in 
using  the  skills  and  techniques  prescribed  in  the  University  of  Oregon 
model  when  teaching  reading  and  math.     We  simply  could  not  come  up  with 
a  recommendation  that  would  specify  the  rate  of  questions  or  reinforce- 
ment to  be  expected  from  even  the  most  structured  models. 

In  lieu  of  the  ideal  of  exact  specifications  for  each 
model,  an  appropriate  and  realistic  alternative  was  to  ask  each  sponsor 
to  rate  the  FMO  variables  as  to  (1)  importance  to  the  model  and  (2)  ex- 
pected frequency  of  occurrence  relative  to  "conventional"  classrooms, 
according  to  the  following  definitions: 
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(1)     Importance  to  the  Model—Rating  Citegories 


Critical — This  is  an  essential  program  component. 
Its  absence  in  one  of  our  classrooms  would  mean 
that  the  program  was  not  iraplemented.     It  is  em- 
phasized in  training  the  teaching  staff. 

Important — This  program  component  is  considered 
beneficial  to  children  and  the  teaching  staff  is 
strongly  encouraged  to  include  this  in  the  class- 
room; however,  absence  of  this  element  would  not 
indicate  poor  implementation. 

Not  Relevant — This  is  not  a  part  of  the  curriculum 
we  have  developed.     It  is  something  with  which  we 
do  not  concern  ourselves;  the  occurrence  or  lack 
of  occurrence  would  not  be  important. 

(2)     Expected  Frequency  Relative  to  Conventional  Class- 
rooms— Rating  Categories 

More — This  should  occur  more  frequently  in  our 
classrooms  than  in  conventional  classrooms. 

Same — This  should  occur  about  as  often  in  conven- 
tional classrooms  as  in  our  classrooms. 

Less — This  should  occur  less  frequently  in  our 
classrooms  than  in  conventional  classrooms. 

Only  variables  that  were  considered  critical  and  that 
should  occur  more  often  in  the  sponsors'  classrooms  were  used  as  imple- 
mentation variables.     Sponsors  were  also  asked  to  rank-order  variables 
on  the  CCL.     The  amount  of  time  allotted  to  each  activity  over  a  week's 
time  was  ranked,  as  were  the  materials  to  be  use  .  in  the  activities 
and  the  preferred  groupings  of  children  and  adults.     Finally  the  spon- 
sors weie  asked  to  add  observation  variables  which  they  thought  might 
provide  more  explicit  info-rmation  regard!. .g  the  implementation  of  their 
model.    The  variables  that  were  finally  selected  for  each  model  from 
_he  Sponsor  Variable  Questionnaire  are  used  in  the  sections  that  follow 
to  assess  model  implementation.     As  car  be  seen  on  Table  11,  there  is 
considerable  overlap  in  the  variables  chosen  by  the  sponsors.  However, 
it  is  the  unique  mix  of  variables  that  makes  the  models  different  from 
one  another.    As  previously  stated,  all  variables  critical  to  sponsors' 
implementation  have  not  been  recorded.    The  variables  selected  represent 
the  best  descriptors  the  evaluators  and  sponsors  could  construct  which 
could  be  observed  reliably  in  sponsor  classrooms.    The  intercorrelations 
of  each  sponsor's  critical  variables  are  presented  in  Appendix  0. 
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d •      Computing  Implementation  Scores 


Two  questions  were  addressed  in  this  analysis: 

-  Are  the  classrooms  of  a  given  model  similar  to  each 
other  on  selected  variables? 

-  Are  a  sponsor's  classrooms  different  from  traditional 
classrooms  on  the  implementation  variables? 

The  first  step  in  the  assignment  of  implementation  scores 
was  to  establish  a  standard  of  comparison  for  each  implementation  vari- 
able.    Since  Follow  Through  programs  are  intended  to  be  innovative  pro- 
grams that  offer  alternatives  to  the  conventional  classroom,  Non-Follow 
Through  classrooms  were  used  as  the  standard  from  which  Follow  Through 
classrooms  should  differ  in  specified  ways.    The  standard  was  established 
separately  for  the  first  and  third    ^ades.     Each  Follow  Through  class- 
room was  assigned  an  implementatioK  score  on  each  of  the  corresponding 
sponsor's  implementation  variables.     The  score  is  a  number  between  1 
and  5  that  represents  the  position  of  the  Follow  Through  classroom  mean 
or  value  relative  to  the  distribution  of  Non-Follow  Through  classroom 
means  or  values.    A  nonparametric  scaling  technique  was  used  rather  than 
one  that  employs  the  mean  and  standard  deviation  of  the  Non-Follow  Through 
classrooms  because  of  the  variety  of  distributions  that  were  encountered 
for  the  Non-Folxow  Through  classrooms  (see  Appendix  M,  Table  M-1) .  As 
an  illustration,  Figures  20-21  display  histograms  of  first  grade  Non- 
Follow  Through  classrooms  on  two  selected  implementation  variables  as 
well  as  the  mean  and  standard  deviation.    The  distribution  in  Figure  20 
has  the  familiar  bell  shape  and  the  distribution  in  Figure  21  has  a  J 
shape.     In  Figure  21,  one  measurement  is  ctn  outlier.    Any  parametric  ap- 
proach that  may  be  appropriate  for  one  type  of  distribution  may  be  in- 
appropriate for  another  type.    Also,  the  nonparametric  procedure  we  have 
elected  to  use  tends  to  be  less  sensitive  to  outliers  than  a  more  conven- 
tional parametric  procedure. 

Several  plans  for  establishing  a  standard  means  for  com- 
parison were  considered  and  discussed  with  a  panel  of  educational  re- 
searchers (see  page  11).    The  previous  SRI  observation  report  (Stallings, 
1973)  had  used  quartile  cutpoints  in  the  distribution  of  Non-Follow 
Through  classroom  means  to  compute  implementation  scores  for  each  Follow 
Through  sponsors'  classroom.    More  refined  divisions  of  the  Non-Follow 
Through  distribution  were  considered  Pixch  as  using  deciles;  however, 
since  there  were  only  35  Non-Follow  Through  first  grade  classrooms,  only 
3.5  Non-Follow  Through  classrooms  would  be  represented  in  each  decile. 
This  suggestion  was  rejected  on  the  basis  that  the  precision  of  the  esti- 
mation of  the  Non-Follow  Through  distribution  did  not  warrant  such  a  re-- 
fined  distinction  in  measuring  implementation.    As  a  reasonable  compromise 
a  quintile  distribution  of  Non-^Follow  Through  classroom  means  was  selected 
to  be  the  standard  measurement. 
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imp J ementat ion  scores  for  each  sponsor  were  determined 
by  rank  ordering  the  Kon-Follow  Through  classroom  mean  scores  on  each 
sponsor  variable  and  dividing  the  distribution  into  five  equal  parts. 
There  are  35  Nou-FoHovn?  Through  first  grades.    The  seventh  lowest  score 
is  the  first  quintile  cutpoinL;  the  fourteenth  lowest  score  is  the  second 
quint  tie  outpoint;  the  twenty-first  lowest  score  is  the  third  quintile 
cutpoint;  and  the  twenty-eighth  lowest  score  is  the  fourth  quintile  cut- 
point.    Any  FolJow  Through  classrooms  which  have  a  score  equal  to  or 
below  the  seventh  score  are  in  the  first  quintile.     Any  Follow  Through 
cJassroom  having  a  score  above  the  twenty-eighth  Non-Follow  Through  score 
is  in  the  fifth  quintile.     Figure  22  shows  the  cutpoints  for  implementa- 
tion scores  for  the  variable  "Games,  toys,  play  equipment  present"  for 
the  first  grade  Non-Follow  Through  classrooms.     See  Appendix  N  for  a 
methodological  discussion  of  the  accuracy  of  quintile  estimates. 
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FIGURE  22      NON-FOLLOW  THROUGH  FIRST  GRADE  CLASSROOMS- 
GAMES,  TOYS,  PLAY  EQUIPMENT  PRESENT  (VAR.  25) 


Each  sponsor's  classrooms  were  assigned  an  implementation 
score  according  to  the  placement  of  the  sponsor  classroom  means  among 
the  quintile  cutpoints.     If  the  classroom  mean  was  greater  than  the 
fourth  quintile  cutpoint,  an  implementation  score  of  5  was  assigned  to 
the  classroom;  if  the  mean  was  less  than  or  equal  to  the  fourth  quintile 
cutpoint,  but  greater  than  the  third  quintile  cutpoint,  a  score  of  4  was 
assigned.     The  quintile  scores  of  3,  2,  and  1  were  assigned  in  the  same 
way.     An  inplementation  score  of  5  indicates  that  the  mean  ox  the  vari- 
able for  the  follow  Through  classroom  exceeded  that  of  at  least  28  class- 
rooms, or  80%,  or  the  Non-Follow  Through  classrooms.     If  a  sponsor's 
classroom  received  an  implementation  score  of  4  or  5,  we  could  say  that 
the  classroom  was  on  the  upper  end  of  the  Non-Follow  Through  distribution; 
a  score  of  J  indicates  that  the  classroom  is  in  the  mid-range  of  the  Non- 
Follow  Through  distribution;  and  a  score  of  1  or  2  indicates  that  the 
classroom  is  on  the  lower  end  of  the  Non-Follow  Through  distribution. 
The  quintile  cutpoints  for  each  implementation  variable  are  presented  in 
Appendix  M, 

There  arc  some  exceptions  to  the  above  specification  of 
the  implementation  scores  when  several  quintile  cutpoints  have  a  value 
of  zero.     This  occurs  when  14  (40^)  or  more  of  the  Non-Follow  Through 
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classrooms  have  a  mean  of  zero  on  a  var'  .^le.     (See  Figure  23  for  an 
example.)     In  such  cases  the  rule  was  adopted  that  when  the  value  for  a 
Follow  Through  classroom  was  z^ro,  the  implementation  score  assigned  to 
that  classroom  corresponds  to  the  highest  quintile  cutpoint  that  was 
zero.    For  example,  if  the  third  quintile  cutpoint  was  greater  than  zero 
and  the  second  quintile  cutpoint  was  equal  to  zero,  then  a  Follow  Through 
classroom  with  a  value  of  zero  would  obtain  an  implementation  score  of 
2  on  that  variable. 
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FIGURE  23      NGN-FOLLOW  THROUGH  FIRST  GRADE  CLASSROOMS- 
TEACHER  WITH  TOO  CHILDREN  (VAR.  87) 


In  several  instances  28  (80%)  or  more  of  the  Non-Follow 
Through  classrooms,  at  a  given  grade  level,  had  means  of  zero  on  seven 
implementation  variables  (Variables  70,  74,  93,  450,  469,  514,  515,  see 
Ap'^endix  M)  so  that  all  quintile  cutpoints  were  equal  to^zero.  (See 
Figure  24.)    Decision  rules  assigned  an  implementation  score  of  4  for 
these  variables  to  a  Follow  Through  classroom  unless  the  classroom  mean 
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FIGURE  24      NON-FOLLOW  THROUGH  FIRST  GRADE  CLASSROOMS- 
SEWING,  COOKING,  POUNDING  (VAR.  70) 


was  above  zero.    Any  classroom  that  had  a  mean  above  zero  on  these  vari- 
ables would  receive  an  implementation  score  of  5.     In  any  case  the  re- 
corded implementation  score  of  4  could  be  misleading  and  scores  should  be 
interpreted  with  caution.     It  must  be  remembered  that  even  though  some 
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variables  are  infrequent,  it  is  important  to  note  whether  they  occur  in 
sponsored  classrooms  and  not  in  the  Non-Follow  Through  classrooms.  (See 
Table  M-1  in  Appendix  M  to  identify  those  variables  where  two  or  more 
quintile  cutpoints  were  the  same.)     In  addition  to  those  cases  mentioned 
above  there  are  a  few  cases  when  t,^o  quin tiles  in  sequence  had  the  same 
value.     (This  occurred  for  three  physical  environment  variables;  see 
Appendix  M  for  Variables  24,  27,  37.) 

A  tonal  implementation  score  for  a  classroom  was  computed 
by  summing  Lhe  implementation  scores  across  the  corresponding  sponsor's 
implementation  variables  and  then  dividing  by  the  highest  possible  sum* 
The  resulting  proportion  was  then  multiplied  by  100  so  that  the  total 
implementation  score  is  expressed  in  terms  of  a  percentage  of  the  total 
possible.     For  example,  if  a  hypothetical  sponsor's  classroom  were  being 
rated  on  four  variables,   the  hii;hest  possible  sum  of  implementation  scores 
for  a  classroom  would  be  4  x  5  =  20.     If  a  classroom  had  implementation 
scores  of  3,  3,  4,  and  5  on  the  individual  implementation  variables,  then 
the  total  implementation  score  for  the  classroom  would  be   (15/20)100  =  75%. 
The  reader  needs  to  understand  that  there  is  no  zero  point  when  computing 
implementation  scores.     If  all  classrooms  received  the  lowest  implementa- 
tion score  of  1  on  every  single  implementation  variable,  their  overall 
implementation  score  would  be  20%,  not  zero.     If  they  received  scores  of 
5,   their  overall  implementation  score  would  be  100%.     Thus,  the  actual 
range  is  from  20  to  100  and  the  midpoint  is  a  score  of  60. 

In  order  to  compare  the  sponsor  programs  with  Non-Follow 
Through  classrooms,  a  total  implementation  score  was  also  computed  for 
each  Non-Follow  Through  classroom  on  each  sponsor'c  set  .^I  implementa- 
tion variables.     The  mean  and  standard-deviation  of  the  Non-Follow  Through 
pooled  classrooms  are  reported  for  each  sponsor.    These  statistics  serve 
three  purposes: 

-  The  Non-Follow  Through  mean  serves  as  a  reference  point 
for  an  implementation  score.     If  all  the  quintile  cut- 
points  had  been  distinguishable,  then  the  mean  total 
implementation  score  for  the  Non-Follow  Through  class- 
rooms would  be  60  (an  average  score  of  3  on  each  vari- 
able out  of  5  possible  on  all  variables) .     Since  there 
are  a  number  of  variables  where  some  or  all  Non-Follow 
Through  quintiles  are  zero,  it  was  necessary  to  compute 
a  separate  mean  for  each  set  of  sponsor-implemented 
variables. 

-  The  standard  deviation  was  used  as  a  scaling  factor 

to  compare  n  sponsor's  total  implementation  score  rela- 
tive to  the  Non-'Follow  Through  score.     A  t-test  was 
used  to  test  whether  the  r^an  total  implementation 
score  for  Follow  Through  was  significantly  greater 
than  t^e  mean  for  Non-Follow  Through. 


'^The  reliability  of  the  estimates  of  the  quintile  cutpoints  is  examined 
in  Appendix  N. 
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An  analysis  of  variance  was  run  separately  for  each  spon^ 
sor  and  grade  level  to  test  whether  the  sites  differed  on  total  imple- 
mentation scores.    This  test  indicates  whether  the  variability  in  imple- 
mentation SCO. BS  among  sites  is  large  relative  to  the  within-site  vari- 
ability among  classrooms  at  a  site. 

3.      Teacher  Questionnaire 

In  an  effort  to  unders-tand  the  relationship  between  the  degree 
of  model  implementation  and  the^ sponsor ' s  teacher  training,  several  anal- 
yses were  conducted.     Sponsor^stated  emphasis  in  training  was  compared 
with  teachers'  perceptions  of  emphasis  in  training.     Reports  of  teacher 
training  and  selected  teacher  characteristics  were  correlated  with  the 
classroom  total  implementation  scores,  teacher  descriptions  of  the  struc- 
ture of  their  classrooms  were  tabulated,  and  results  for  each  sponsor's 
site  were  compared. 

Results 

The  report  of  implementation  findings  is  presented  for  each  spon-- 
sor  in  a  separate  section.     Model  descriptions  and  site  descriptions 
are  presented  rirst,  followed  by  implementation  findings. 

1,      Responsive  Educational  Model— Far  West  Laboratory 
a.      Description  of  the  Model 

The  Responsive  Educational  Progr.-am  model  advocates  struc- 
turing learning  activities  so  that  they  are  self-rewarding  (autotelic) , 
and  providing  an  environment  that  is  responsive  to  each  child*s  needs. 
The  child^s  culture  and  the  child^s  interests  are  the  cornerstones  upon 
which  the  curriculum  is  built.    According  to  the  autotelic  principle,  a 
child  learns  best  in  an  environment  where  he  can  try  out  things  that 
interest  him,  and  in  which  he  can  risk,  guess,  ask  questions,  and  make 
discoveries,  without  serious  negative  psychological  consequences.  Auto- 
telic activities  include  experiences  and  learning  activities  that  are 
viewed  as  helping  a  child  to  develop  a  skill,  learn  a  concept,  acquire 
self  direction  and  inner  controls. 

\n  a  Far  West  Laboratory  classroom,  the  child  is  free  to 
explore  and  to  choose  activities  within  a  carefully  controlled  environ- 
ment that  contains  learning  centers  and  a  variety  of  games,  activities, 
and  experiences.    The  child  can  search  for  solutions  to  his  problems  in 
his  own  way,  using  a  variety  of  resources.    Rather  than  being  directive, 
the  adults  pose  questions  and  guide  the  child  to  the  discovery  of  solu- 
.tions  which  may  fit  together  and  lead  in  turn  to  still  other  discoveries. 
The  child^s  intrinsic  satisfaction  and  pleasure  in  the  experience  are 
considered  to  be  his  reward,  rather  than  extrinsic  rewards.  * 
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The  assumption  is  that  no  single  theory  of  learning  can 
account  for  all  the  ways  in  which  children  learn*     It  is  considered 
essential  that  a  variety  of  educational  alternatives  be  available  to 
build  on  whatever  background,  cultural  influence,  or  life  style  the  child 
brings  to  school* 

Either  individual  children  or  small  groups  of  children 
can  be  found  in  a  variety  of  learning  centers*    Teacher,  aides  or  vol- 
unteers may  work  with  a  small  group  ur  with  individual  children.  Con- 
crete objects  are  often  used  for  instructional  purposes.     In  order  to 
promote  child  inquiry,  adults  are  most  likely  to  ask  leading  open-ended 
questions  or  to  respond  to  a  child's  question  with  another  question. 

b.      Descriptions  of  the  Sites 

In  or  ler  to  provide  the  reader  with  an  idea  of  the  con- 
text vvlthin  l^Jhich  the  observational  data  were  collected,  demographic  de- 
scriptions of  each  site  have  been  prepared.  Observations  were  conducted 
at  five  Far  Wesc  Laboratory  sites:  Berkeley,  California;  Duluth,  Minne- 
sota; Lebanon,  New  Hampshire;  Salt  Lake  City,  Utah;  and  Tacoma,  Washing- 
ton . 

Four  geographic  regions  established  by  the  U.S.  Bureau 
of  the  Census  are  represented  in  the  Far  West  sites  (see  Table  12).  Four 
Far  West  cities  were  classified  as  medium  sized  cities.     Only  Lebanon 
is  classified  ac*  a  town. 

The  median  family  incomes  are  quite  similar  across  the 
five  sites.     Correspondingly,  the  five  sites  show  similarities  in  per- 
centages of  families  below  poverty  le-el,^  with  a  difference  of  less 
than  3%  between  the  highest  and  lowest. 

There  are  marked  differences  in  nonwhite  populations 
among  the  Far  West  sites.     Berkeley  has  a  32.3%  nonwhite  population, 
while  Lebanon's  is  only  0.6%.     Note  that  Berkeley's  nonwhite  population 
is  approximately  one  third  more  than  the  average  for  Follow  Through. 
Appendix  B  presents  an  analysis  of  the  effect  of  basic  site  character- 
istics.   Apparently,  Far  West  classroom  processes  are  not  affected  by 
ethnic  differences. 

The  percentage  of  the  adult  population  over  25  years  of 
age  in  the  five  Far  West  sites  who  have  completed  high  school  is  high 
relative  to  the  Follow  Through  average.     Berkeley's  77%  in  this  category 
is  the  highest  for  all  observed  sites  for  all  sponsors;  Tacoma's  55.5%, 
the  lowest  of  the  Far  West  sites,  is  still  higher  than  the  average  for 
ail  Follow  Through. 


'^The  U.S.  Census  Bureau  uses  the  U.S.  Office  of  Economic  Opportunity 
poverty  index  guidelines  to  establish  ^'Poverty  level." 
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Table  12 


SITE  AND  DEMOGRAPHIC  DATA  FOR  FAR  WEST  LABORATORY  SITES 


A.    Geographic  Data 


Site 
Code 

0201 
0204 

0207 
0209 
0213 


Site  Location 

Berkeley,  Calif. 
Dulutb,  Minn- 


Lebanon,  N.H . 
Salt  Lake  City, 
Tacoma,  Wash. 


Utah 


Region 

Pacific 
West  North 

Central 
North  East 
Mountain 
Pacific 


Metropolitan 
Status 

Medium  city 
Medium  city 

Town'^ 

Medium  city 
Medium  city 


Population 
(1970  census) 

116,716 
100,578 

9,725 
175,885 
154,581 


B.     Demographic  Data  for  Total  Population 


Site  Name 

Berkeley 

Duluth 

Lebanon 

Salt  Lake  City 

Tacoma 


Median  Percent  of  Percent  of 

Family  Families  Below  Population 

Income  Poverty  Level  Nonwhite 

$9,987  10.0%  32.3% 

9,313  7.4  1.7 

9,125  8.0  0.6 

8,817  10.1  3.2 

9,537  9.2  9.2 


Percent  of 
Adults  Over  25 
VJho  Finished 
High  School 

77.0% 

58.9 

60.3 

64.5 

55.5 


Average  for 
all  sites 


$8,  oil        1  13.9% 


20.7% 


49.7% 


C.     Characteristics  of  the  Follow  Through  Evaluation  Sample 


at  the  Sits  for  First  Grade 


Site  Name 

Berkeley 

Duluth 

Lebanon 

Salt  Lake  City 

Tacoma 


Average  Percent 
with  Preschool 

— % 

52 

20 

48 

64 


Average  Percent  with  Average 
Firs'..  Language  Baseline 
Other  than  English  Score 


0% 
0 
0 
12 
0 


33 

32 
33 


Not  within  Standard  Metropolitan  Statistical  Area  (SMSA) . 

k 

Taken  from  the  Follow  Through  Roster;  represents  the  Follow  Through 

evaluation  sample. 


Sources:     U.S.  Bureau  of  the  Census,  1970;  SRI 
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The  baseline  scorus  tor  the  first  grade  children  are  very 
similar.     This  is  true  even  for  Salt  Lake  City  where  12%  of  them  do  not 
use  English  as  their  first  language.' 


c.  Sponsor  Implementation  Variables 

Tables  of  the  variables  selected  to  assess  implementation 
of  the  Far  West  model  can  be  found  in  Appendix  M  along  with  the  imple- 
mentation score  for  each  variable  for  each  classroom.    As  described  in 
the  methodology  section  of  this  chapter,  the  final  selection  of  variables 
was  made  on  the  basis  of  sponsor  ratings  in  the  Sponsor  Variable  Ques- 
tionnaire.    How  the  implementation  scores  were  computed  is  described  in 
the  methodology  section  on  page  100.     Since  the  aim  of  sponsors  was  to 
differ  in  specific  ways  from  traditional  classrooms,  the  traditional 
classroom  has  been  used  as  the  standard  yardstick  to  measure  each  spon- 
sor's implementation.     Far  West  selected  27  variables  on  which  they 
would  expect  their  classrocmb  to  deviate  from  the  conventional  classrooms. 
An  implementation  score  of  3  would  indicate  the  classroom  was  in  the  mid- 
range  of  conventional  classrooms;  an  implementation  score  of  5  would  mean 
the  model  classrooms  were  in  the  uppermost  range  of  conventional  class- 
rooms.   As  previously  stated,  the  variables  selected  for  the  Far  West 
model  are  limited  descriptors  of  the  program.    Many  processes  and  pro- 
cedures important  to  the  program  are  not  assessed  in  this  study  of  im- 
plementation . 

d.  Implementation  Findings 

Figure  25  and  Table  13  present  the  total  implementation 
scores  for  each  classroom  for  each  site  and  over  all  sites  for  first  and 
third  grade  classroows.    These  total  scores  were  computed  by  adding  each 
quintile  score  of  Far  West  Laboratory's  27  implementation  variables  and 
dividing  by  the  total  possible  score.    The  scores  are  presented  as  per-- 
centages.     Total  scores  for  Non-Follow  Through  classrooms  were  also  com- 
puted for  the  Far  West  Laboratory  implementation  variables.    Means  and 
standard  deviations  are  presented  in  Table  13  along  with  the  results  of 
one-tailed  t-tests,  comparing  Non-Follow  Through  with  Far  West  Labora- 
tory.    In  addition.  Table  13  presents  the  analysis  of  variance  among  sites. 

All  Far  West's  classroom  scores  are  above  the  Non-Follow 
Through  mean,  and  the  histograms  presented  in  Figure  25  indicate  there 
is  little  overlap  in  tlie  Far  West  and  Non-Follow  Through  classroom  scores. 
The  analysis  of  variance  suggests  that  there  is  no  statistical  differ- 
ence in  the  among-site  variance  anc  the  within-site  variance.     The  great- 
est difference  is  seen  in  the  third  grade  between  Salt  Lake  City  which 
has  a  mean  of  83  and  Duluth  and  Lebanon  wiiose  means  are  71.    The  larg  t 
standard  deviation  within  a  site  is  found  in  Duluth  third  grades.  Although 
it  might  be  more  difficult  for  teachers  to  implement  the  model  when  chil- 
dren don't  understand  the  language,   the  12%  of  children  who  do  not  speak 
English  as  a  first  language  does  not  seem  to  have  affected  the  implementa- 
tion of  the  model  in  Salt  Lake  City,  since  the  implementation  scores  there 
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Table  13 


TOTAL  IMPLEMENTATION  SCORES  FOR  CLASSROOMS  BY  SITL—FAR  WEST  LABS 


First  Grade 


Sites 

Classroom 

Scores 

Site 

Scores 

1 

2 

3 

A 

X 

S.D. 

Berkeley 

(EK) 

72.6% 

79.3% 

75.6% 

71.9% 

74 . 8% 

3.4 

Duluth 

(EK) 

76.3 

8A.A 

80.7 

80.0 

80.4 

3.3 

Lebanon 

(EK) 

81.5 

75.6 

8A.A 

80.7 

80.6 

3.7 

Salt  Lake  City 

(EK) 

80.  7 

85.9 

75.6 

80.0 

80.6 

4.2 

Tacoma 

(EK) 

78.5 

71.9 

78.5 

71.1 

75.0 

4.1 

Sponsor  Scores  (N  = 

20) : 

78.3% 

4.4 

NFT  Scores  (N 

=35): 

60.3 

6.3 

t  -  11.28 
P  <  .001 
f  »  2.65 
p  <  NS 


Third  Grade 


Sites 

Classroom 

Scores 

Site 

Scores 

1 

2 

3 

4 

X 

S.D. 

Berkeley 

(EK) 

82.2% 

70.4% 

79.3% 

71.9% 

75.9% 

5.7 

Duluth 

(EK) 

7A.1 

61.5 

80.0 

71.1 

71.7 

7.7 

Lebanon 

(EK) 

69.6 

77.8 

74.1 

64.4 

71.5 

5.8 

Salt  Lake  City 

(EK) 

84.4 

89.6 

76.3 

85.2 

83.9 

5.6 

Tacoma 

(EK) 

79.2 

84.4 

80.7 

72.6 

79.2 

5.0 

Sponsor  Scores  (N= 

20)  : 

76.4% 

7.2 

NFT  Scores  (N 

=  36)  : 

59.0 

9.4 

t  =  7.18 
p  <  .001 
f  =  3.07 
p  <  .05 
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are  particularly  high.    As  the  t-tests  indicate,   the  overall  Far  West  classroo 
classroom  means  at  both  first  and  third  grades  are  significantly  different 
from  Non^Follow  Through  classrooms* 

Scores  for  each  critical  implementation  variable  for  each 
Far  West  Laboratory  site  and  classroom  are  presented  in  Appendix  M,  Table 
M^3,  in  tabular  form.     The  tables  are  prepared  so  that  the  number  of 
classrooms  receiving  a  particular  implementation  score  is  entered  in  a 
column.    The  numbers  of  classrooms  from  each  site  are  entered  in  the  rows. 
The  total  number  of  classrooms  receiving  a  particular  implementation 
score,  as  well  as  the  percentage  computed,  is  entered  in  the  bottom  rows. 
Only  a  few  critical  variables  will  be  discussed  in  this  text. 

As  presented  in  Table  14,  four  first  grade  classrooms 
in  Salt  Lake  City  have  the  highest  implementation  score  (5)  on  the  use 
of  blocks  and  trucks  (Var.  71).     Overall,  65%  of  the  Far  West  classrooms 
were  at  the  upper  end  of  the  scale  on  this  variable.    Of  the  Non-Follow 
Through  classrooms,  40%  had  a  mean  of  zero  which,  as  explained  in  the 
methodology  section,  suggests  that  Far  West  classrooms  receiving  a  score 
of  3  could  also  have  a  mean  of  zero*    However,  as  shown  in  the  Annex,* 
all  Far  West  first  grade  sites  had  some  blocks  and  trucks  present.  (The 
lack  of  entries  for  the  third  grade  on  this  variable  is  e'iplained  by  the 
fact  that,  for  developmental  reasons,  Far  West  did  not  select  this  vari- 
able as  an  essential  component  for  third  grade  implementation.) 


Table  14 


BLOCKS,  TRUCKS  (Variable  71) —FAR  WEST 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


Sites 

1* 

2* 

3 

4 

5 

Berkeley,  Calif. 

3 

1 

Duluth,  Minn, 

1 

2 

1 

Lebanon,  N.H. 

1 

3 

Salt  Lake  City,  Utah 

4 

Tacoma,  Wash. 

2 

1 

_1_ 

Total  classrooms 

7 

3 

10 

Percent  of  class- 

rooms 

35% 

15% 

50% 

Of  the  Non-Follow  Through  classes,  40%  (the  two  lowest 
quintiles)  had  a  mean  of  zero  on  this  measurement,  but 
none  of  the  Far  West  sites  had  a  mean  of  zero  (see  text). 


The  Annex  is  available  for  consultation  at  SRI. 
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As  indicaled  in  Table  15  for  Variable  83  (Wide  variety 
of  activities,  over  one  day),  most  first  grade  teachers  in  four  sites 
ranked  in  the  fifth  quintile.     Seventeen  of  the  twenty  teachers  in  the 
third  grade  had  classrooms  with  implementation  scores  of  A  or  5.  This 
variable  is  important  Lo  the  Far  West  Lab  program,  since  a  wide  variety 
of  activities  provides  the  children  an  opportunity  to  work  with  mate- 
rials independently. 


Table  15 

WIDE  VARIETY  OF  ACTIVITIES,  OVER  ONE  DAY  ^N^ariable  83)~FAR  WEST 


Sites 


First  Grade  Classrooms 
with  Implementation 

 Scores  of  

1        2        3        A  5 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


Berkeley,  Calif. 
Duluth,  Minn. 
Lebanon,  N.H. 
Salt  Lake  City,  Utah 
Tacoma,  Wash. 

Total  Classrooms 


4 
1 
4 
4 

4 

17 


3 
3 
4 

2 
1 

13 


Percent  of  class- 
rooms 


157,  85% 


15%    20%  65% 


Table  16  shows  how  Far  West  classrooms  score  on  children 
working  independently.     As  shown,  Far  West  children  are  more  often  inde- 
pendent :,n  activities  than  most  Non-Follow  Through  children. 

Table  17  indicates  that  Far  West  classrooms  in  third 
grade  have  more  small  groups  of  children  working  together  than  Non-Follow 
Through  classrooms;  they  are  at  the  upper  end  of  the  scale  on  Variable 
116  at  all  five  sites.    Of  the  Far  West  first  grade  classrooms,  70%  are 
in  the  „'ifth  quintile  for  independent  group  work,  and  90%  of  the  third 
grades  are  in  the  fifth  quintile. 

In  Table  18,  scores  for  Variable  86  (Teacher  with  one 
child)  indicate  that  Far  West  children  are  receiving  more  individual 
attention  than  comparison  children.    This  is  especially  true  in  Salt 
Lake  City  and  Tacoma  where  all  four  first  grade  classrooms  scored  in  the 
fifth  quintile.     Over  all  classrooms,  data  show  that  children  from  Far 
West  first  and  third  grades  are  at  the  upper  end  of  the  scale  in  the  re- 
ceipt of  individual  attention  from  teachers. 
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Table  16 

ONE  CHILD  INDEPENDENT  (Variable  11»0~FAR  WEST 


Sites 


Berkeley,  Calif. 
Duluth,  Minn. 
Lebanon,  N.H. 
Salt  Lake  City,  Utah 
Tacoma,  Wash. 

Total  classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


16 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


k 
k 
3 
A 

k 

19 


Percent  of  class- 
rooms 


!0%  80% 


5%  95% 


Table  17 


SMALL  GROUP  OF  CHILDREN  INDEPENDENT  (Variable  116) —FAR  WEST 


Sites 


Berkeley,  Calif. 
Duluth,  Minn. 
Lebanon,  N.H. 
Salt  Lake  City,  Utah 
Tacoma,  Wash. 

Total  classrooms 


F  rst  Grade  Classrooms 
with  Implementation 
Scores  of 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


2 

2 
3 
k 
3 


k 
3 
k 
k 
3 

18 


Percent  of  class- 
rooms 


5%    10%    15%  70% 


10%  90% 


llA 


Table  18 


TEACHER  WITH  ONE  CHILD  (Variable  86) —FAR  WEST 


Sites 


Berkeley,  Calif. 
Duluth,  Minn. 
Lebanon,  N.H. 
Salt  Lake  City,  Utah 
Tacoma ,  Wash . 

Total  Classrooms 


First  Grade  Classrooms 
with  Implementation 

_  Scores  of  

1        2        3        4  5 


2 
3 
4 
4 

13 


Third  Grade  Classrooms 
with  Implementation 

Scores  of 
1        2        3       4  5 

1  1 

1 

1 


2 
3 
3 
3 
4 

15 


Percent  of  class- 
rooms 


30%    65%  5% 


10%    10%  75% 


Another  variable  related  to  Variable  86  (Teacher  with  one 
child)  is  Variable  375a  (Adult  instructs  an  individual  child).    As  can 
be  seen  in  Table  19,  all  of  Tacoma's  first  and  third  grade  classrooms 
are  in  the  fifth  quintile  on  this  variable.     Individualized  instruction 
is  an  important  Far  West  Laboratory  strategy,  especially  in  the  first 
grade,  and  all  first  grade  classrooms  in  Table  19  show  an  implementation 
score  of  4  or  5. 


Table  19 

ADULT  INSTRUCTS  AN  INDIVIDUAL  CHILD  (Variable  375a)— FAR  WEST 


Sites 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


Third  Grade  Classrooms 
with  Imp 1 emen ta t ion 
Scores  of 


Berkeley,  Calif. 
Duluth,  Minn. 
Lebanon,  N.H. 
Salt  Lake  City,  Utah 
Tacoma,  Wash. 

Total  classrooms 


3  1 
4 

4 

3  1 


10  10 


2 
1 
2 
3 
4 

12 


Percent  of  class- 
roo.TS 


50%  50% 


5%    10%    25%  60% 
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The  variable  "Adult  open-ended  questions  to  children" 
(Var.  452a)  is  considered  to  be  an  important  method  for  encouraging  child 
thinking.    Approximately  50%  of  the  Far  West  classrooms  have  an  implemen- 
tation score  of  5.    All  of  the  Far  West  first  grades  in  Lebanon  and  all 
of  the  Far  West  third  grades  in  Salt  Lake  City  were  in  the  fifth  quintile. 
Scores  for  the  other  classrooms  are  scattered  over  the  other  four  quin- 
tiles  (Table  20). 


Table  20 

ADULT  OPEN-ENDED  QUESTIONS  TO  CHILDREN  (Variable  452a)— FAR  WEST 


Sites 


Berkeley,  Calif, 
Duluth,  Minn. 
Lebanon,  N.H. 
Salt  Lake  City,  Utah 
Tacoma,  Wash, 

Total  classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


J. 
3 
4 

9 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


2 


1 
1 
2 

_1^ 
5 


2 
2 
4 
2 

10 


Percent  of  class- 
rooms 25% 


20%    10%    45%      5%    10%    25%    10%  50% 


When  children  receive  individual  attention  and  are  asked 
open-ended  questions,  it  may  be  that  they  lind  it  easier  to  ask  questions 
of  .idults.     In  both  first  and  third  grades,  60%  of  the  Far  West  class- 
rooms have  an  implementation  score  of  5  for  "Child  questions  to  adult*' 
(Table  21).     Salt  Lake  City  has  all  its  Far  West  classrooms  in  the  fifth 
quintile.    All  of  Duluth^s  Far  West  third  grades  also  received  an  imple- 
mentation score  of  5.    Overall,  88%  of  the  classrooms  have  an  implemen- 
tation score  of  4  or  5  which  places  them  at  the  upper  end  of  the  scale. 


e.      Summary  of  Implementation 

As  was  noted  earlier,  all  of  the  Far  West  sites  were 
similarly  implemented  when  total  scores  are  considered.    There  is  little 
within-site  or  among-site  difference  in  these  scores.     When  using  the 
comparison  classrooms  as  a  yardstick,  the  Far  West  Laboratory's  class- 
room scores  are  high  and  are  statistically  different  from  Non-Follow 
Through  scores. 
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Table  21 


CHILD  QUESTIONS  TO  ADULTS  (Variable  350a)— FAR  WEST 


Sites 


First  Grade  Classrooms 
with  Imp] ementation 
Scores  of 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


Berkeley,  Calif. 
Duluth,  Minn. 
Lebanon,  N.H. 
Salt  Lake  City,  Utah 
Tacoma,  Wash. 

Total  classrooms 


3 
1 
3 
4 
1 

12 


1 

A 

4 

12 


Percent  of  class- 
rooms 


15%    25%  60% 


10%    30%  60% 


The  results  fron  the  observer  accuracy  study  indicate  that 
the  third  grade  observer  in  Berkeley  coded  less  than  60%  of  the  4  code 
(instruction,  explanatirn)  accurately  (see  Appendix' L,  Table  L-1) .  How- 
ever, the  data  reported  on  Table  20  which  used  the  4  code  do  not  appear 
dissimilar  from  other  sites  on  this  variable.    They  all  are  on  the  upper 
end  of  uhe  measuring  stick  when  compared  to  Non-Follow  Through.     The  ob- 
server in  the  first  grade  at  Lebanon  had  an  accuracy  rate  of  less  th^n  60% 
on  IQ  codes,   (direct  question).     However,  on  the  variable  "Child  question- 
ing an  adult"  which  uses  this  code,  the  data  from  Lebanon  first  grade  ap- 
pear similar  to  the  data  of  other  first  grade  sites. 

The  reader  is  reminded  that  a  sponsor's  implementation  is 
evaluated  in  two  ways:     (1)  Do  the  sponsor's  classrooms  differ  from  the 
traditional  classroom?  and  (2)  Are  a  given  sponsor's  classrooms  similar 
to  each  other  in  level  of  implementation?     Using  these  criteria  we  con- 
clude that  the  Far  West  Laboratory  would  be  able  to  implement  their  model 
in  other  sites  similar  to  the  ones  used  in  this  analysis. 


2.      Tucson  Early  Education  Model  (TEEM) — University  of  Arizona 

a.      Description  of  the  Model 

Using  the  child's  characteristics  when  he  begins  school 
as  a  base,  the  TEEM  model  attempts  to  develop  a  foundation  for  his  fu- 
ture learning.     The  goal  is  to  increase  the  child's  competence  by  im- 
proving his  skills  in  four  general  curriculum  areas:     (1)  development 
of  language  competence;   (2)  development  of  an  intellectual  base  (ability 
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to  attend^  recall,  organize,  and  evaluate);   (3)  development  of  a  motiva- 
tional base  (attitudes  of  productive  involvement  such  as  a  liking  for 
school  and  for  learning,  task  persistence,  and  expectation  of  success); 
and  (4)  development  of  societal  arts  and  skills  (reading  and  math  skills, 
social  skills  of  cooperation,  ability  to  plan).    These  skills  are  to  be 
devr'oped  in  a  functional  setting  where  concepts  are  illustrated  by  the 
use  of  practical  examples  from  the  child's  home  and  school  environment. 
Thus,  the  use  of  Che  home,  neighborhood,  and  community  as  instructional 
resources  is  central  to  the  model. 

The  classroom  is  organized  around  a  variety  of  behavioral 
settings  and  learning  centers.     Children  are. allowed  to  make  choices  re- 
garding their  activities  and  seating  arrangements.     Small  groups  of  chil- 
dren are  able  to  learn  from  each  other  and  are  given  individual  attention 
from  adults.     Teachers  are  expected  to  be  models  of  desired  behavior. 
The  sponsor  ox  TEEM  believes  that  the  child's  acquisition  of  language 
and  other  skills  is  affected  by  such  modeling  on  the  part  of  adults. 
Children  are  encouraged  to  ask  questions  and  adults  respond  with  liberal 
quantities  of  praise,  support,  attention,  and  affection.    Every  effort 
is  made  to  ensure  that  the  child  will  come  to  regard  school  as  signifi- 
cant, desirable,  and  rewarding. 


b.      Description  of  the  Sites 

Project  sites  under  the  University  of  Arizona's  sponsor- 
ship are  Des  Moines,  Iowa;     ort  Worth,  Texas;  LaFayette,  Georgia;  Lake- 
wood,  New  Jersey;  Lincoln,  Nebraska;  and  Newark,  New  Jersey.  They 
represent  four  geographic  regions  of  the  country.     Demographics  for  the 
six  sites  are  indicated  on  Table  22. 

The  sites  range  from  large  cities  to  a  small  town.  The 
far  iy  incor.8  ranges  about  $2,000,  but  the  percent  of  families  below 
poverty  level  ranges  from  5.6  in  Lincoln  to  18.4  in  Newark.    Newark  also 
has  larges  percent  (56%)  of  non-white  families  and  Lincoln  the  lowest 
(2%).     The  percentage  of  adults  over  25  who  have  finished  high  school 
ranges  from  12.8%  in  Lincoln  to  30%  in  LaFayette  (Newark  is  also  in  the 
low  range  with  33.2%).    More  of  the  first  grade  children  in  Newark  have 
had  preschool  experience  (73%)  than  in  most  other  sites;  only  30%  of  the 
children  in  Lincoln  have  had  preschool. 

In  Fort  Worth  23%  and  in  Lakewood  18%  of  the  Follow  Through 
children  do  not  speak  English  as  their  first  language.    The  baseline  test 
score  is  lower  for  Lakewood  than  for  other  sites,    l^ether  or  not  this 
lower  score  is  related  to  the  children  who  do  not  speak  English  as  a 
first  language  is  not  analyzed  in  this  report.     (Tests  are  given  in  English 
only  and  children  entering  school  might  be  expected  to  score  lov;er  on  tests.) 
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Table  22 

SITE  AND  DEMOGRAPHIC  INFORMATION  FOR  UNIVERSITY  OF  ARIZONA  SITES 


A.    Geographic  Data 


Site 

Metropolitan 

Population 

Code 

Site  Location 

Region 

Status 

(1970  census) 

0305 

Des  Moines,  iowa 

West  North  Central 

Big  city 

220,587 

0307 

Fort  Worth,  Texas 

West  South  Central 

Big  city 

393,476 

0308 

LaFayet te ,  Georgia 

South  Atlantic 

Town* 

6,092 

0309 

Lakewood ,  N.J. 

Middle  Atlantic 

Small  city* 

17,8^4 

0311 

Newark,  N.J. 

Middle  Atlantic 

Big  city 

382,417 

0316 

Lincoln,  Nebraska 

West  North  Central 

Medium  city 

149,518 

Demographic 

Data  for  Total  Populat 

Percent  of 

Median  Percsnt 

Percent  of 

Adults  Over 

Family      Families  Belcw 

Population 

Wh 0  Finishe 

Site  Name 

Income      Poverty  Level 

Nonwhi te 

Hiah  School 

Des  Moines 

$10,239  6.9% 

6.2% 

65.3% 

Fort  Worth 

9,271  10.3 

20.6 

48.8 

LaFayette 

7,966  15.7 

8.1 

30.0 

Lakewood 

7,961  14.6 

20.1 

47.5 

Newark 

7,735  18.4 

56.0 

33.2 

Lincoln 

€      9,928  5.6 

2.3 

72.8 

Average  for 

all  sites 

$  8,631  13.9% 

20. 7f^ 

49.7% 

Characteristics  of  Follow  Through  Evaluation  Sample 

at  the  Site 

for  First  Grade** 

Average 

Percen^  with 

Average 

Average  Percent             First  Language 

Baseline 

Site  Name 

with  Preschool  Other 

than  English 

Score 

De'j  Moines 

39% 

0% 

32 

Fort  Worth 

80 

23 

LaFayette 

52 

0 

Lakewood 

26 

18 

25 

Newark 

73 

3 

28 

Lincoln 

30 

1 

33 

Not  within  Standard  Metropolitan  Statistical  Area  (SMSA). 

-k-k 

Taken  from  the  Follow  Through  Roster;  represents  the  Follow  Through 
evaluation  sample. 

Sources:    U.S.  Bure-^u  of  the  Census,  1970;  SRI 
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c ,      Sponsor  Implementation  Variables 


The  variables  selected  to  assess  implementation  and  ex- 
portability  of  the  University  of  Arizona  model  can  be  found  in  Appendix 
M,    The  tables  in  Appendix  M  show  the  implementation  scores  for  each 
variable  for  each  classroom.    As  described  in  the  methodology  section 
of  this  chapter,  the  final  selection  of  variables  was  made  on  the  basis 
of  sponsor  ratings  reported  on  the  Sponsor  Variable  Questionnaire.  The 
variables  selected  for  the  University  of  Arizona  model  are  of  course 
limited  descriptors  of  the  program.    Many  processes  and  procedures  im- 
portant to  the  program  are  not  assessed  in  this  study  of  implementation. 
For  instance,  one  of  the  model's  goals  is  for  small  groups  of  children 
to  learn  from  each  other.    Our  variables  record  only  that  the  children 
are  working  together.     We  cannot  judge  whether  or  not  they  are  learning 
from  each  other.     How  the  implementation  scores  were  computed  is  de- 
scribed in  the  methodology  section  on  page  100.     Since  the  aim  of  the 
sponsors  was  to  provide  programs  that  differ  in  specific  ways  from  tra- 
ditional classrooms,  the  traditional  classroom  has  been  used  as  the 
standard  yardstick  to  measure  each  sponsor's  implementation,  T\;enty-one 
variables  were  selected  by  University  of  Arizona  as  critical  to  their 
model,  and  there  is  the  expectation  that  their  classrooms  will  differ 
from  conventional  classrooms  on  these  variables.    An  implementation 
score  of  3  would  indicate  the  classroom  was  in  the  mid-range  of  conven- 
tional classrooms;  an  implementation  score  of  5  would  mean  the  model 
classrooms  were  in  the  uppermost  range  of  conventional  classrooms. 

A  selection  of  variables  indicated  by  the  University  of 
Arizona  as  being  critical  to  their  model  are  discussed  in  the  text. 
Tables  of  all  other  critical  variables  are  presented  in  Appendix  M, 

d.      Implementation  Findings 

Figure  26  and  Table  23  present  the  total  implementation 
scores  for  each  classroom  by  grade  level.     These  total  scores  were  com- 
puted by  adding  each  quintile  score  of  University  of  Arizona's  21  imple- 
mentation variables  and  dividing  by  the  total  possible  score.    Thus,  an 
average  score  on  all  variables  was  computed.     The  scores  are  presented 
as  percentages.     Total  scores  for  Non-Follow  Through  classrooms  were  also 
computed  fcr  the  University  of  Arizona  implementation  variables.  Means 
and  standard  deviations  are  presented  in  Table  23  along  with  the  re- 
sults of  one-tailed  t-tests,  comparing  Non-Follow  Through  classrooms 
with  classrooms  using  the  University  of  Arizona  model.    Table  23  presents 
the  analysis  of  variance  among  sites. 

The  F  tests  on  Table  23  indicate  that  in  both  grade  levels 
for  the  University  of  Arizona  there  is  a  statistical  difference  in  the 
variance  among  sites  from  the  variance  within  sites  in  implementation 
scores.     The  greatest  difference  is  seen  in  the  first  grade  between  Lin- 
c^.  In  with  a  mear  r>f  83  and  Newark  with  a  mean  of  55.    The  standard  de- 
viation within  sites  ranges  from  1.5  in  the  Newark  first  grades  to  10.9 
in  the  Des  Moines  third  grades. 
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As  indicated  by  the  t-tests  there  is  a  significant  dif- 
ference between  the  total  implementdtion  scores  in  both  the  first  and 
third  grade  University  of  Arizona  classrooms  and  the  first  and  third 
Non-Follow  Through  classrooms.     Histograms  presented  in  Figure  26  indi- 
cate there  is  overlap  in  the  Univcirsity  of  Arizona  and  the  Non-Follow 
Through  classrooms.    Much  of  the  overlap  is  accounted  for  by  the  class- 
rooms in  Newark.     It  can  be  noted  that  the  total  score  of  implementation 
for  Newark  is  lower  than  the  Non-Follow  Through  implementation  score  in 
first  grade  and  approximately  the  same  in  third  grade.    The  previous 
section  describing  sites  suggested  that  Newark  differs  from  other  sites 
in  that  they  have  laore  families  below  poverty  level,  they  have  a  larger 
nonwhite  population  and  have  a  lower  percent  of  adults  who  have  not 
finished  high  school.    Unfortunately  we  are  not  able  to  examine  in  this 
analysis  the  extent  to  which  community  demographics  impinge  upon  imple- 
mentation.    The  characteristics  of  children  in  Newark  are  similar  to  those 
at  other  sites.     In  general  they  have  had  a  few  more  months  in  Follow 
Through,  a  greater  percent  have  had  preschool  and  their  baseline  WRAT 
scores  are  in  the  upper  ranges  of  site  means  (see  Tables  3  and  4).  The 
population  is  apparently  less  transient  than  at  other  sites,  since  81% 
of  the  children  who  had  been  tested  when  entering  kindergarten  were  found 
in  first  grade.    The  only  difference  apparent  in  the  child  characteris- 
tics is  the  higher  percent  of  black  students  in  the  Newark  classrooms. 
However,  Appendix  B  (page  B-14)  indicates  that  the  c^ild's  ethnicity 
does  not  effect  the  classroom  processes  (i.e.,  control  systems  and  af- 
fect shown)  in  the  University  of  Arizona  classrooms.    An  examination  of 
observer  accuracy  at  Newark  leads  to  the  conclusion  that  the  data  were 
properly  collected  (see  Appendix  L,  Table  L-2,  for  observer  reliability). 
A  study  of  observer  accuracy  for  other  University  of  Arizona  sites  indi- 
cates that  the  codes  which  form  the  variables  in  this  section  were 
acceptably  reliable.    A  discission  with  a  representative  at  the  Univer- 
sity of  Arizona  suggested  thre^  ^  .>ssible  explanations  for  the  lower  im- 
plementation scores  in  Newark:     (1)  The  sponsor  had  difficulties  in  pro- 
viding optimum  classroom  ser^/ices  during  the  first  years  of  sponsorship. 
(2)  Newark  schools  have  all  of  the  problems  of  large  inner-city  schools, 
including  a  high  rate  of  families  below  the  poverty  level.     (3)  Some 
segments  of  the  school  community  preferred  educational  models  that  em- 
phasized teaching  the  basic  skills  at  an  early  age,  so  that  considerable 
time  had  to  be  spent  in  developing,  both  in  teachers  and  in  parents,  an 
understanding  and  an  appreciation  of  an  educational  plan  that  integrated 
the  basic  skills  into  a  total  curriculum.     Regardless  of  the  low  imple- 
mentation score  reported  in  this  study,  the  sponsor  is  pleased  with  the 
progress  Newark  has  rride  over  the  years  toward  implementation. 

The  large  percent  of  children  speaking  English  as  a  sec- 
ond language  does  not  seem  to  have  negatively  affected  the  implementation 
of  the  model  in  Ft.  Worth  and  Lakewood  since  their  implementation  scores 
in  both  grades  are  high. 

Scores  for  each  critical  implementation  variable  for  each 
University  of  Arizona  site  and  classroom  are  presented  in  Appendix  M, 
Table  M-3  in  tabular  form.    The  tables  are  prepared  so  that  the  number 
of  classrooms  receiving  a  particular  implementation  score  is  entered  in 
a  cclu.T.n.    The  numbers  of  classrooms  from  each  site  are  entered  in  the 
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Table  23 


TOTAL  IMPLEMENTATION  SCORES  FOR  CLASSROOMS  BY  SITE—UNIVERSITY 

OF  ARIZONA 


First  Grade 


Classroom 

Scores 

Site 

Scores 

Sites 

1 

2 

3 

4 

X 

S.D. 

Des  Moines  (EK) 

79.0% 

k9    Q  V 

.  j/o 

7  1    A  7 

A  7 

Fort  Worth  (El) 

85,7 

78.1 

70.5 

75.2 

77.4 

6.4 

LaFayette  (El) 

79.0 

71.4 

87.6 

79.4 

8.1 

Lakewood  (EK) 

78.1 

74.3 

76.2 

79.0 

76.9 

2.1 

Newark  (EK) 

57.1 

54.0 

56.2 

54.3 

5.S.4 

1.5 

Lincoln  (EK) 

89.5 

88.6 

74.3 

81.0 

83.3 

7.1 

Sponsor  Scores 

(N=23): 

73.6% 

10.7 

NFT  Scores  (N=35) : 

61.8 

7.0 

t.  =  4 

.99 

P  < 

.001 

f  =  11 

.76 

P  < 

.001 

Third 

Grade 

Classroom 

Scores 

Site 

Scores 

Sites 

1 

2 

3 

4 

X 

S.D. 

Des  Moines  (EK) 

65.7% 

52.4% 

53.3% 

75.2% 

61.7% 

10.9 

Fort  Worth  (El) 

66.7 

80.0 

82.9 

84.8 

78.6 

8.2 

LaFayette  ^El) 

68.6 

71.4 

73.3 

87.6 

75.2 

8.5 

Lakewood  (EK) 

76.2 

78.1 

76.2 

73.3 

76.0 

2.0 

Newark  (EK) 

61.9 

63.8 

67.6 

63.8 

64.3 

2.4 

Lincoln  (EK) 

77.1 

75.2 

78.1 

81.9 

78.1 

2.8 

Sponsor  Scores 

(N=24); 

72.3% 

9.1 

NFT  Scores  (N= 

36): 

60.7 

9.3 

t  =  4.77 
p  <  .001 
f  =  4.75 
p  <  .01 
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rows.  The  total  number  of  classrooms  receiving  a  particular  implementa- 
tion score,  as  well  as  the  percentage  computed,  is  entered  on  the  bottom 
rows.     Only  a  few  critical  variables  will  be  discussed  in  this  text. 

For  example.  Table  24  indicates  that  compared  to  Non^ 
Follow  Through,  University  of  Arizona  third  grade  children  were  more 
often  allowed  to  choose  their  own  seating  and  grouping  (15  classrooms 
are  in  the  fourth  or  fifth  quintile).    Games  and  other  play  equipment 
were  present  in  more  University  of  Arizona  first  grades  than  comparison 
classrooms  (20  of  their  23  classrooms  are  in  the  fourth  or  fifth  quin- 
tile).    Seventeen  of  the  24  third-grade  classrooms  were  in  the  fourth 
or  fifth  quintile  (Table  25). 

Findings  shown  in  Table  26  indicate  how  much  more  emphasis 
the  traditional  comparison  classroom  places  on  arithmetic.    This  variable 
assesses  the  frequency  of  occurrence  and  the  number  of  children  involved 
in  arithmetic.    Over  82%  of  the  first  and  88%  of  the  third  grade  class- 
rooms using  the  University  of  Arizona  model  scored  in  the  first  or  second 
quintile  on  this  variable.     However,  this  is  likely  to  be  an  underesti- 
mate of  the  time  the  children  engage  in  reading  or  math,  since  the  basic 
skills  are  used  to  cook,  bake,  and  construct.    For  example,  children 
reading  recipes  and  measuring  ingredients  would  be  coded  in  cooking 
rather  than  in  reading  or  math.    Also,  the  reader  is  reminded  that  the 
day-to-day  variability  of  this  variable  was  quite  large  for  both  first 
and  third  grades,  suggesting  that  the  variable  is  not  very  stable  (see 
p.  54). 

The  University  of  Arizona  does  not  emphasize  any  single 
activ"'*"  '  but  rather  encourages  an  interdisciplinary  program  where  sev- 
eral activities  can  occur  at  one  time  and  basic  skills  can  be  learned 
by  participation  in  all  of  these.     Results  in  Table  27  denote  success 
in  this  effort.    Nineteen  of  the  23  first  grade  classrooms  have  an  im- 
plementation score  of  4  or  5  and  21  third  grade  classrooms  have  a  score 
of  4  or  5. 

Results  shown  in  Tables  28  and  29  indicate  that  at  Uni- 
versity of  Arizona  sites,  teachers  more  often  work  with  small  groups 
(92%  in  third  grade  have  an  implementation  score  of  5)  and  children  are 
independent  more  often  than  comparison  children  (over  70%  in  both  first 
and  third  grades  have  implementation  scores  of  4  or  5). 

The  frequency  of  children  asking  questions  ranges  within 
sites  and  among  sites  (see  Table  30).     Lakewood>^has  all  of  its  first 
and  third  grades  scoring  either  a  4  or  5  on  implementation  of  this  vari- 
able, and  all  of  the  Lincoln  third  grades  have  an  implementation  score 
of  5. 

Having  adults  ask  children  open-ended  questions  is  im- 
portant to  the  model,  since  it  describes  an  attempt  to  extend  children's 
thinking.     Table  31  reflects  a  wide  range  of  implementation  scores.  All 
of  the  University  of  Arizona  first  grades  at  Des  Moines  received  the 
highest  implementation  score.     Three  of  the  third  grades  received  a  high 
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Table  24 

CHILD  SELECTION 

OF  SEATING 

AND 

WORK  GROUPS 

(Variable 

24) 

—UNIVERSITY  OF 

ARIZONA 

First 

Grade  Classrooms 

Third  Grade  Glassrooms 

with  Implementation 

with  Implementation 

Scores  of 

Scores  of 

Sites  1 

2 

5 

1        2        3       4  5 

Des  Moines,  Iowa 

1 

3 

3  1 

Fort  Worth,  Texas 

1 

3 

3  1 

LaFayette,  Georgia 

3 

1        1  2 

Lakewood,  N.J. 

1 

3 

3  1 

Newark,  N.J. 

2 

1 

1 

3  1 

Lincoln,  Nebraska 

A 

1  3 

Total  classrooms 

6 

6 

11 

4        5      10  5 

Percent  of  class- 

rooms 2 

6% 

25% 

48% 

17%    IV/    42%  21% 

Table  25 

GAMES,  TOYS,   PLAY  EQUIPMENT  PRESENT 

(Variable  25) —UNIVERSITY 

OF  ARIZONA 

First 

Grade  Classrooms 

Third  Grade  Classrooms 

Implenientati  on 

with  Implementation 

Scores  of 

Scores  of 

Sites  1 

2 

3  4 

_5_ 

1        2        3       4  5 

Des  Moines,  Iowa 

A 

4 

Fort  Worth,  Texas 

4 

4 

LaFaye t  te ,  Georg  ia 

3 

2  2 

Lakewood,  N.J. 

4 

4 

Newark,  N.J.  ] 

1  1 

1 

2        1  1 

Lincoln,  Nebraska  

2 

1        1  2 

Total  class- 

rooms 1 

2  2 

18 

3        4        5  12 

Percent  of 

classrooms  4% 

97  9'/ 

78% 

13%    17%    21%  50% 
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Table  26 


NUMBERS,  MATH,  ARITHMETIC  (Variable  66)— UNIVERSITY  OF  ARIZONA 


Sites 


Des  Moines,  Iowa 
Fort  Worth,  Texas 
LaFayette,  Georgia 
Lakewood,  N.J. 
Newark,  N.J. 
Lincoln,  Nebraska 

Total  class- 
rooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


2 
3 
2 
2 
3 
3 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


1 
2 
3 
3 

2 
A 


15 


15 


Percent  of 
classrooms 


17%    65%      4%      9%      4%    63%  25% 


8%  4% 


Table  27 

WIDE  VARIETY  OF  ACTIVITIES,  OVER  ONE  DAY  (Variable  83)— UNIVERSITY 

OF  ARIZONA 


Sites 


Des  Moines,  Iowa 
Fort  Worth,  Texas 
LaFayette,  Georgia 
Lakewood,  N.J. 
Newark,  N.J. 
Lincoln 

Total  class- 
rooms 

Percent  of 
classrooms 


First  Grade  Classrooms      Third  Grade  Classrooms 
with  Implementation           with  Implementation 
Scores  of  Scores  of  


2                2  2 

4  4 

2  4 

4  1  3 

1  1  2 

4  A. 


3        1  3      16  2       1        2  19 

13%     4%  13%    70%  8%      4%      8%  79% 
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Table  28 


TEACHER  WITH  SMALL  GROUP  (Variable  88)— UNIVERSITY  OF  ARIZONA 


First  Grade  Classrooms      Third  Grade  Classrooms 
with  Implementation  with  Implementation 

 Scores  of    Scores  of  

Sites   1234512345 


Des  Moines,  Iowa  3        1  13 

Fort  Worth,  Texas  13  4 

LaFayette,  Georgia  3  4 

Lakewood,  N.J,  1                3  1  3 

Newark,  N.J.  2        11  4 

Lincoln,  Nebraska      4    4 


Total  class- 

roonis  2        1        1        5      14  1        1  22 

Percent  cf 

classrooms  9%      4%      4%    22%    61%  4%      4%  92% 


Table  29 

ONE  CHILD  INDEPENDENT  (Variable  114)— UNIVERSITY  OF  ARIZONA 


First  Grade  Classrooms      Third  Grade  Classrooms 
with  Implementation  with  Implementation 

Scores  of  Scores  of 


Sites 

1 

2 

3 

A 

5  1 

2 

3 

4 

5 

Des  Moines,  Iowa 

1 

1 

2 

2 

1 

1 

Fort  Worth,  Texas 

1 

3 

1 

3 

LaFayette ,  Georgia 

3 

1 

2 

1 

Lakewood,  N.J. 

2 

2 

1 

3 

Newark,  N.J. 

2 

1 

1 

1 

X 

2 

1 

Lincoln,  Nebraska 

2 

2 

4 

Total  class- 

rooms 

2 

2 

o 

5 

12 

2 

A 

6 

12 

Percent  of 

Classrooms 

9% 

9% 

97. 

22% 

52% 

82 

177 

25'A 

50% 
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Table  30 


CHILD  QUESTIONS  TO  ADULTS  (Variable  350a)— UNIVERSITY  OF  ARIZONA 


Sites 


Des  Moines,  Iowa 
Fort  Worth,  Texas 
LaFayette,  Georgia 
Lakewood,  N.J. 
Newark,  N.J. 
Lincoln,  Nebraska 

Total  class- 
rooms 


First  Grade  Classrooms 
with  Implementation 

 Scores  of  

1        2        3        4  5 

3  1 


3 
2 
3 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


1 

2 
3 
1 


2 
1 
1 
2 

10 


Percent  of 
classrooms 


13%     9%    17%    26%  35% 


8% 


21%    29%  42% 


Table  31 


ADULT  OPEN-ENDED  QUESTIONS  TO  CHILDREN  (Variable  452a)— UNIVERSITY 

OF  ARIZONA 


Sites 


Des  Moines,  Iowa 
Fort  Worth,  Texas 
LaFayette,  Georgia 
Lakewood,  N.J. 
Newark,  N.J. 
Lincoln,  Nebraska 

Total  class- 
rooms 

Percent  of 
classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


2 
1 


2 
4 


13 


4%    15%      4%    17%  57% 


Third  Grade  Classrooms 
with  Implementation 

 Scores  of  

1        2        3        4  5 

1  3 

3 
1 

1    1  2 

3       6       6  9 

13%    25%    25%  38% 


1 
3 


2 
1 
2 
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score,  but  one  third  grade  scored  only  2,    Lakewood  also  had  all  Uni- 
versity of  Arizona  first  grades  with  an  implementation  score  of  5*  Over- 
all, 74%  of  the  firsc  grades  at  University  of  Arizona  sites  received  an 
implementation  score  of  4  or  5  on  Var.  452a,  and  63%  of  the  third  grades 
received  an  imple^    aation  score  of  4  or  5, 

Ivflien  adults  ask  children  questions,  it  is  important  to 
the  University  of  Arizona  model  that  children  not  only  respond  but  that 
they  also  extend  their  response  beyond  a  simple  "yes"  or  "no,"  Table 
32  presents  data  which  indicates  that  children  in  University  of  Arizona 
first  grades  other  than  Newark,  more  often  extend  their  answers  when  re- 
plying to  questions  than  do  comparison  Non-Follow  Through  children,  Des 
Moines,  Ft.  Worth,  and  LaFayette  also  have  third  grade  classrooms  in  the 
fourth  or  fifth  quintile. 


Table  32 

CHILD'S  EXTENDED  RESPONSE  TO  QUESTIONS  (Variable  454a)— UNIVERSITY 

OF  ARIZONA 


Sites 


First  Grade  Classrooms 
with  Implementation 

 Scores  of  

1        2        3        4  5 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


Des  Moines,  Iowa 
Fort   -Jorch,  Texas 
LaFayette,  Georgia 
Lakewood ,  N.J. 
Newark,  N.J. 
Lincoln,  Nebraska 

Total  class- 
rooms 


2 
11 


Percent  of 
classrooms 


177 


9%    26%    48%    13%    21%    25%    17%  23% 


Discussion  of  a  topic  is  an  important  learning  method 
and  p'*ocess  to  the  University  of  Arizona  model;  i.e.,  one  learns  through 
discussion  of  a  subject,  and  learning  to  communicate  ideas  is  an  impor- 
tant skill.     Table  33  presents  data  regarding  the  task-related  comments 
of  children.     Overall,  61%  of  the  first  grades  and  46%  of  the  third 
grades  have  implementation  scores  of  4  or  5  on  Var.  456a.     Fort  Worth 
has  all  first  and  third  grades  in  the  fifth  quintile.    Newark's  first 
and  third  grades  are  in  the  first  and  second  quintiles  on  this  variable* 
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Table  33 

ALL  CHILD  TASK--RELATED  COMMENTS  (Variable  456a)— UNIVERSITY  OF  ARIZONA 


Sites 


Des  Moines,  Iowa 
Fort  Worth,  Texas 
LaFayette ,  Georgia 
Lakewood,  N.J. 
Newark,  N. J . 
Lincoln,  Nebraska 

Total  class- 
rooms 


First  Grade  Classrooms 

with  Implementation 
 Scores  of  

__L_    A-   ^    A-  A 
3 


1 
4 
2 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


_2. 

1 

1 
1 


4 
1 


Percent  of 
classrooms 


22%    13%     A%    22%    39%    25%    17%    13%    25%  21% 


e.       Summary  of  Implementation 

There  is  considerable  deviation  reported  within  sites  and 
among  sites  for  the  University  of  Arizona  model  than  for  most  other  spon- 
sors.    LaFayette  contributed  more  than  other  sites  to  this  deviation  at 
both  first  and  third  grades.     Lakewood  is  well  implemented  at  both  grade 
levels.     There  is  slight  deviation  between  classrooms,  and  the  total 
site  implementation  score  is  at  the  upper  end  of  the  scale.     Other  sites 
(Des  Moines,  Fort  Worth,  LaFayette,  and  Lincoln)  have  high  implementation 
scores  but  more  within  site  deviation  among  classroom  scores.  Newark 
has  very  little  deviation  between  classrooms  in  either  the  first  or  third 
grades;  however,  their  total  implementation  scores  are  very  low  when  com- 
pared to  the  Non-Follow  Through  total  implementation  scores  on  the  Uni- 
versity of  Arizona  variables. 

The  reader  is  reminded  that  a  sponsor's  implementation  is 
evaluated  in  two  ways:     (1)  Do  the  sponsor's  classrooms  differ  from  the 
traditional  classroom?  and  (2)  Are  a  given  sponbor's  classrooms  similar 
to  each  other  in  level  of  implementation? 

Thus  we  conclude  that  Lakewood  is  implemented  according 
to  both  criteria,  while  Des  Moines,  Fort  Worth,  LaFayette,  and  Lincoln 
are  implemented  according  to  the  first  criterion  and  Newark  is  imple- 
mented according  to  the  second  criterion. 
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3.       Bank  St  reel  College  of  Iviucation  Approach 


a.  Description  of  the  Model 

The  teacher  in  a  Bank  Street  classroom  creates  a  learn- 
ing environment  which  is  both  challenging  and  supportive.     There  are 
opportunities  for  varied  experiences  and  many  options  lor  learning:  The 
teacher  meets  with  the  whole  class  to  share  experiences  and  to  plan  the 
day's  activities.     She  works  primarily  with  individual  children  or  small 
groups.     Even  in  a  group  activity  she  always  has  the  individual  children 
in  mind.     When  she  is  not  actively  engaged  in  a  group  activity,  the 
teacher  moves  about  the  room  analyzing  children's  work  at  various  learn- 
ing centers,  stopping  to  elicit  ideas  from  individuals  or  groups  of 
children,  exchanging  comments  about  the  task,  helping  children  extend 
and  build  upon  their  ideas,  or  acknowledging  their  progress  in  specific 
terms. 

The  assistant,  who  is  a  paraprof essional,  is  a  cooperative 
member  of  the  teaching  team,  and  participates  in  various  learning  activ- 
ities that  liave  been  planned  jointly  with  the  teacher.    The  role  of  the 
assistant  is  very  similar  to  that  of  the  teacher  in  that  both  work  with 
children  on  a  one-to-one  basis  or  in  small  groups  in  order  to  stimulate 
and  extend  learning. 

The  child  in  a  Bank  Street  classroom  is  expecteu  to  take 
an  active  role  in  his  learning.     He  can  choose  learning  activities  and 
use  of  materials.     He  can  also  participate  in  large  and  small  group  ex- 
periences planned  by  or  with  aduJts,  such  as  discussions,  story  telling, 
or  use  of  Cuisenaire  rods.     However,  most  of  the  child's  activities  do 
not  require  adult  direction  but  are  enhanced  by  adult  response,  support, 
recognition,  and  extension.     Independent  activities  may  be  engaged  in 
by  the  child  individually  or  cooperatively  with  one  or  more  other  chil- 
dren.    In  general,  academic  experiences   (reading,  writing,  computing) 
are  integrated  functionally  into  classroom  activities  such  as  cooking, 
experimenting  with  science  equipment  and  making  things  (e.g.,  creative 
stories,  woodwork).     However,  texts  and  workbooks  are  used  occasionally. 
The  child  is  encouraged  to  use  language  throughout  the  day.     He  questions 
and  exchanges  comments  with  his  peers  and  the  adults  in  the  classroom, 
which  are  viewed  as  revealing  his  ability  to  think,  to  reason,  and  to 
express  himself  with  positive  affect.     The  program  emphasis  is  on  having 
the  child  experience  work  at  first  hand. 

b.  Description  of  the  Sites 

The  five  Bank  Street  sites  arr-  Brattleboro,  Vermont;  Fall 
River,  Massachusetts;  New  York  City;   Philac^eiphia;  and  Tuskegee,  Ala- 
bama.    Demographic  and  other  information  describing  the  communities  in 
which  the  Follow  Through  projects  are  located,  some  taken  from  U.S.  Census 
data  and  some  from  Follow  Through  sources,  is  presented  for  the  five 
Bank  Street  sites  in  Table  34. 
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Table  34 


SITE  AND  DEMOGRAPHIC  DATA  FOR  BANK  STREET  COLLEGE  SITES 


A.    Geographic  Data 
Site 

Code       Site  Location 


Region 


Metropolitan  Population 
Status  (1970  census) 


0502    B^attleboro,  Ver- 
mont 

0504  Fall  Ri-  Mass. 
0506    New  Yot.v  ' 

P.S.  243r. 
0508    Philadelphia  II, 

Pa. 

0510    Tuskegee,  Ai.u 


North  East 


Small  city* 


North  East  Medium  city 

Middle  Atlantic    Big  city 


Middle  Atlantic 


g  city 


East  South  Cen-    Small  city* 
tral 


12,239 

96,898 
7,894,798 

1,948,609'' 

11,028 


B.  Demographic  Dat    'or  ^otal  Population 


Si^^  Name 


Median        Percent  of 
Family    Families  Below 
Income    Poverty  Level 


Percent  of 
Population 
Nonwhite 


Percent  of 
Adults  Over  25 
Who  Finished 
High  School 


Brattleboro 

$9,938 

6 

6% 

0. 

6% 

59. 

7% 

Fall  River 

8,289 

10 

8 

1. 

0 

25. 

6 

NYC  P.S.  243K 

9,682 

11 

5 

23. 

4 

46. 

9 

Philadelphia  II 

9,366 

11 

2 

34 

4 

39. 

9 

Tuskegee 

7,000 

23 

5 

88 

2 

59. 

/ 

Average  for 

all  sites 

$8,631 

13 

9% 

20 

7% 

49 

/% 

C.     Characteristics  of  the  Follow  Through  Evaluation  Sample 


at  the  Site   for  First  Grade 


Site  Name 

Brattleboro 
Fall  River 
NYC  P.S.  243K 
Philadelphia  II 
Tuskegee 


Average  Percent 
with  Preschool 

27% 

36 

47 

30 

74 


Average  Percent  with  Average 

First  Language  Baseline 

Other  than  English  Score 

0%  27 

^4  24 

0  33 

0  28 
0 


Not  win'iin    tandard  Metropolitan  Statistical  Area  (SMSA) 

Taken  from  the  ^bllow  Through  Roster;  represent^  the  Follow  Through 
evaluation  sample , 

Souf'es:    U.S.  Bureau  of  the  Census,  1070;  SRI 
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Brattleboro  and  Tuskegee  are  both  small  cities;  Brattle- 
boto  is  in  New  England  while  Tuskegee  is  in  the  deep  South.     Both  sites 
have  a  high  percent  (59.7%)  of  adults  who  have  completed  high  F'^hool 
and  neither  site  has  children  who  speak  English  as  a  second  language. 
However,  the  two  sites  are  diverse  in  other  respects.  Brattleboro's 
$9,938  median  family  income  is  higher  than  the  average  for  Follow  Through, 
while  Tuskegee 's  median  family  income  of  $7,000  is  considerably  below  the 
Follow  Through  sample's  average.     Following  naturally  from  their  differ- 
ent median  incomes.  Brat t  leboro ' s  6.6/^  of  families  below  poverty  level^ 
is  among  the  lowest  in  Ltie  sample;  while  Tuskegee 's  23.5%  of  poverty 
families  is  a»iiong  the  highest.     The  largest  difference  between  the  two 
sites  occurs  in  their  nonwhite  populations:     Brat t leboro' s  nonwhite  pop- 
ulation is  0.6%  (the  lowest  of  the  Bank  Street  sites),  whereas  Tuskegee' s 
is  88.2%  (the  highest). 

The  demographic  data  for  New  York  City  and  Philadelphia, 
both  large  Eastern  cities,  are  quite  similar.     Their  median  family  in- 
comes differ  by  orly  $300  and  are  above  the  average  for  Follow  Through; 
their  percent  of  families  below  poverty  level  is  almost  identical  and 
slightly  lower  than  the  Follow  Through  average.     Although  the  nonwhite 
populations  of  the  cities  differ  by  11%,  both  cities  have  approximately 
98%  black  children  in  their  Follow  Through  classrooms. 

Fall  River  is  a  medium-sized  New  England  industrial  city. 
It  has  a  large  Portuguese-speaking  population  which  is  reflected  in  the 
fact  that  34%  of  the  children  in  the  Follow  Through  samole  do  not  speak 
English  as  a  first  language.     The  entering  baseline  tes^s  are  lower  than 
other  sices.     This  may  be  a  result  of  not  having  English  as  a  first 
language  since  the  tests  are  all  conducted  in  English. 

c .      Sponsor  Implementation  Variables 

The  variables  selected  to  assess  implementation  of  the 
Bank  Street  model  can  be  found  in  Appendix  M.     Ihe  tables  in  Appendix 
M  present  the  implementation  score  for  each  variable  for  each  classroom. 
As  described  in  the  methodology  section  of  this  chapter,  the  final  selec- 
tion of  variables  was  made  on  the  basis  of  sponsor  ratings  reported  on 

J  Sponsor  Variable  Questionnaire.     How  the  implementation  scores  were 
computed  is  also  described  in  the  methodology  section  on  page  100.  Since 
the  aim  of  sponsors  was  to  provide  programs  that  differ  in  specific  ways 
from  traditional  classrooms,   the  traditional  t^lassroom  has  been  used  as 
the  stcadard  yaLdsLick  to  measure  each  sponsor's  implementation.  Twenty- 
seven  variables  were  selected  by  Bank  Street  as  those  on  whicn  they  would 
expect  their  classrooms  to  differ  from  conventional  classrooms.     An  im- 
plementation score  of  3  would  indicate  that  the  classroom  was  in  the  mid- 
range  of  conventional  classrooms;  an  implementation  score  of  5  would 
ivjan  that  the  model  c.lassrooms  were  iti  the  uppermost  range  of  conventional 


*The  U.S.  Census  Bureau  uses  the  U.S.  Office  of  Economic  Opportunity 
poverty  index  guidelines  to  establish  poverty  level. 
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classrooms.     The  variables  selected  for  the  Bank  Street  model  are  of 
course  limited  descriptors  of  the  program.    Many  processes  and  procedures 
of  the  program  are  not  assessed  in  this  study  of  implementation.  For 
example,  the  classroom  adults  are  expected  to  elicit  ideas  from  children 
and  help  them  extend  ideas.     Our  variables  are  a  rough  approximation  of 
whether  this  is  occurring.    We  have  a  variable  which  reports  the  frequency 
of  adults  asking  open-ended  questions  and  another  which  reports  how  often 
the  children  extend  responses,  and  another  which  reports  how  often  adults 
respond  to  children's  questions  with  another  question.    All  three  of  the 
variables  may  be  indicators  of  the  desired  process,  but  by  no  means  pro- 
vide a  complete  assessment  of  the  goal. 

A  selection  of  variable       hat  are  considered  by  the  spon- 
sor to  be  critical  to  the  implementat        of  the  Bank  Street  model  are 
discussed  in  the  text.     Tables  of  all  other  critical  variables  are  pre- 
sented in  Appendix  M. 


d .      Implementation  Findings 

Figure  27  and  Table  35  present  the  total  implemt  .uation  scores 
for  each  classroom  by  grade  level.     These  total  scores  were  computed  by 
adding  each  quintile  score  of  Bank  Street's  27  implementation  variables 
and  diviaing  by  the  total  maximum  score.     Thus,  an  average  score  on  all 
variables  was  computed.     The  scores  are  presented  as  percentages.  Total 
scores  for  Non-Follow  Through  classrooms  wero  also  computed  for  the  Bank 
Street  implementation  variables.    Means  and  standard  deviations  ore  pre- 
sented in  Table  35,  along  with  the  results  of  one-tailed  t-tests,  com- 
paring Non-Follow  Through  with  Bank  Street  classrooms.     Table  35  presents 
an  analysis  of  variance  among  sites. 

As  **he  t-tests  indicate,  the  Bank  Street  classrooms  over- 
all implementation  scores  differ  significantly  from  the  Non-Follow  Through 
classrooms.     Hov^ever,  six  of  the  nineteen  third  grade  implementation 
scores  are  approximately  the  same  as  the  Non-Follow  Through  third  grade 
mean  score  and  the  third  grade  mean  score  in  Philadelphia  is  only  two 
points  above  the  Non-Follow  Through  mean.     Histograms  presented  in 
Figure  27  illustrate  the  overlap  in  Bank  Street  and  Non-Follow  Through 
scores.     The  analysis  of  variance  indicates  that  the  deviation  in  imple- 
mentation scores  among  sites  is  not  different  from  the  deviation  of  im- 
plementation scores  within  sites.     The  deviation  within  sites  is  great- 
est in  the  Fall  River  first  grades  (7.5)  and  the  Tuskegee  third  grades 
(8.1).     The  least  deviation  within  a  site  is  in  the  Tuskegee  first  grades 
(2.0)  where  the  implementation  score  is  also  high. 

Scores  for  each  critical  implementation  variable  for  each 
Bank  Street  site  and  classroom  are  presented  in  Appendix  M,  Table  M-'A  in 
tabular  form.     The  tables  are  prepared  so  that  the  number  of  classrooms 
receiving  a  particular  implementation  score  is  entered  in  a  column.  The 
classrooms  frcn  each  site  are  shown  acrocs  the  rows.     The  total  number 
of  classrooms  receiving  a  particular  implementation  score,  as  well  as 
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the  percentage  computed,  is  entered  on  the  botLom  rows.     Only  a  few  se- 
lected variables  will  be  discussed  in  this  text. 

In  TahK'   36,  all  first  grades  have  an  implementation  score 
of  4  or  5  on  Var.   25  (Toys,  games,  play  equipment  present).    Apparently > 
Nt^w  York  City  third  grade  classrooms  did  not  make  as  much  use  of  this 
type  of  equipment  as  did  third  grades  at  other  sites. 


Table  36 

GAMES,  TOYS,  PLAY  EQUIPMENT  PRESENT  (Variable  25)~BANK  STREET 


Sites 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


Bratt leboro ,  Vetmont 
Fall  River,  Mass. 
N\'C  P.S.  24 3K 
Philadelphia  II,  Pa. 
Tuskegee,  Ala. 

Total  classrooms 


3 
3 
2 

3 

4 

15 


3 
2 

3 
2 

10 


Percent  of  class- 
rooms 


21%  197. 


11%    11%    26%  53% 


One  goal  of  the  Bank  Street  program  is  to  provide  a  multi- 
disciplinary  program.     Such  a  program  is  reflected  in  Variable  83  (Wide 
variety  of  activities,  over  one  day).     Table  37  indicates  that  89%  of 
the  Bank  Street  first  grades  and  79%  of  the  third  grades  have  a  score  of 
4  or  5  on  this  variable. 

The  findings  presented  in  Table  38  indicate  that  the  con- 
ventional classroom  is  more  likely  than  a  Bank  Street  classroom  to  have 
children  engaged  in  formal  math  during  the  day.     However,  this  variable 
does  not  include  the  more  informal  math  which  might  be  learned  during 
such  activities  as  cooking,  sewing,  or  carpentry.     Therefore,  the  number 
of  Bank  Street  children  engaged  in  some  form  of  math  may  be  underestimated. 

Bank  Street  teachers  appear  to  interact  with  children  in 
small  groups  more  often  than  teachers  in  conventional  classrooms  (see 
Table  39).     On  this  variable,  89%  of  the  first  grades  have  an  implemen- 
tation score  of  4  or  5  and  79/'  oi  the  third  grades  have  the  highest  pos- 
sible score  of  5. 
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Table  35 


TOTAL  [MPLEMENTATION  SCORES  FOR  CLASSROOMS  BY  SITE—BANK  STREET 


First  Grade 


Classroom  Scores  Site  Scores 


Sites 

1 

2 

3 

4 

X 

S.D 

Brattleboro 

(EK) 

64. 

4% 

74.1% 

68.9% 

% 

69.1% 

4.8 

Fall  River 

(EK) 

80. 

7 

75.6 

71.1 

63.0 

72.6 

7.5 

NYC  P.S.  243K 

(EK) 

78, 

5 

74.8 

77.0 

67.4 

74.4 

4.9 

Philadelphia 

II 

(EK) 

77. 

8 

82.6 

78.5 

77.0 

79.0 

2.5 

Tuskegee 

(El) 

80. 

0 

78.5 

75.6 

76.3 

77.6 

2.0 

Sponsor  Scores 

(N= 

19): 

74.8% 

5.5 

NFT  Scores 

(N= 

35): 

62.7 

6.2 

t  =  7.12 

p  <  .001 

f  =  2.37 

p  <  NS 


Third  Grade 


Classroom  Scores   Site  Scores 


Sites 

1 

2 

3 

4 

X 

sjp 

Brattleboro 

(EK) 

75.6% 

74.8% 

71.1% 

% 

73.8% 

2.4 

Fall  River 

(EK) 

61.5 

68.9 

68.9 

71.1 

67.6 

4.2 

N'YC  P.S.  243K 

(EK) 

62.2 

68.9 

77.8 

69.6 

69.6 

6.4 

Philadelphia 

II 

(EK) 

63.0 

65.2 

60.0 

70.4 

64.6 

4.4 

Tuskegee 

(El) 

70.4 

81.5 

77.0 

63.0 

73.0 

8.J. 

Sponsor  Scores 

(N= 

19)  : 

69.5% 

6.0 

iNFT  Scores 

(N'= 

36): 

62.4 

8.6 

t  =  3.20 

p  <  .001 

f  =  1.71 

p  <  NS 
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Table  37 


WIDE  VARIETY  OF  ACTIVITIES,  OVER  ONE  DAY  (Variable  83)— BANK  STREET 


Sites 


Brattleboro,  Vermont 
Fall  River,  Mass. 
NYC  P.S  243K 
Philadelphia  II,  Pa. 
Tuskegee,  Ala. 

Total  classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of   


3 

3 
2 
3 

^ 
X 

12 


Third  Grade  Classrooms 
^'ith  Implementation 
Scores  of 


12 


Percent  of  class- 
rooms 


11%    26%  63% 


16%      5%    16%  63% 


Table  38 

NUMBERS,  MATH,  ARITHMETIC  (Variable  66)— BANK  STREET 


Sites 


Brattleboro ,  Vermont 
Fall  River,  Mass* 
NYC  P.S.  243K 
Philadelphia  II,  Pa. 
Tuskegee,  Ala. 

Total  classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


Percent  of  class- 
rooms 37%    16%    11%    21%    16%    21%    32%    21%    16%  11% 
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Table  39 


TEACHER  WITH  S"^IALL  GROUP  (Variable  88) —BANK  STREET 


Mtes 


First  Grade  Classrooms 
vith  Implemen tat  ion 

 Scores  of  

1        2        3       A  5 


Third  Grade ' Classrooms 
wi  th  Implementation 

 Scores  of 

1        2        3       A  5 


Brat tleboro,  Vermont 
Fall  River,  Mass. 
NYC  P.S.  2A3K 
Philadelphia  II,  Pa. 
Tuskegee,  Ala. 

Total  classrooms 


1 


1 


1 
3 
2 

2 


2 

3 
3 
3 

15 


Percent  of  class- 
rooms 


57. 


5%    kl%  kit 


11% 


5%  797 


Children  in  Bank  Street  first  grades  also  receive  con- 
siderably more  individual  attention  from  aides  (Table  AO)  than  do  chil- 
dren in  conventional  classrooms.     Overall,  90%  of  these  classrooms  are 
in  the  fourth  or  fifth  quintile.     While  40%  of  the  Non-Follow  Through 
classrooms  have  mean  scores  of  zero,  none  of  the  Bank  Street  sites, 
whether  at  first  or  third  grade,  have  mean  scores  of  zero  (see  Appendix 
0  for  means) . 

Children  in  Bank  Street  classrooms  often  work  indepen- 
dently in  small  groups.     Findings  presented  in  Table  41  indicate  that  64;: 
of  the  first  and  79%  of  the  third  grades  have  an  implementation  score  of 
4  or  5.     (Sec  A^jpendix  M,  Table  M-4  for  other  tables  regarding  child  in- 
dependence* ) 

Perhaps  to  encourage  their  inquiring,   first  grade  children 
are  asked  open-ended  questions  b>     '.ults  more  often  in  Bank  Street  class- 
rooms than  in  conventional  ones  (see  Table  42).     Fourteen  out  of  19  first 
grade  classrooms  scored  4  or  5  on  this  variable*     Bank  Street's  third 
grades  are  more  evenly  distributed  across  the  implementation  scores. 

It  is  also  important  to  the  Bank  Street  model  that  chil- 
dren ask  questions.     This  is  an  important  part  of  the  learning  process. 
Dat.i  presented  on  Table  43  indicate  that  58^^  of  the  first  grades  h^ve 
implementation  scores  of  4  or  5.     Of  the  third  grades,  37%  are  in  the 
fourth  quintile  but  none  are  in  the  fifth  quintile-     The  children  at 
Brat  tleboro  were  observed  t^-  be  asking  questions  more  often  than  ohildrcj 
at  other  sites. 
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Table  40 

AIDE  WITH  ONE  CHILD  (Variable  92) —BANK  STREET 


Sites 


Brat tleboro,  Vermont 
Fall  River,  Mass. 
mc  P.S.  2A3K 
Philadelphia  II,  Pa. 
Tuskegee,  Ala. 

Total  classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


2 
2 

2 


2 
3 
2 
2 

2 

11 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


3 
2 
3 

1 
12 


Percent  of  class- 
rooms 


11%    32%  58% 


26%    11%  63% 


In  first  grade,  40%  of  the  Non-Follow  Through  classrooms  (the  two  low- 
est quintiles)  had  a  mean  of  zero  while  in  third  grade  20%  of  the  Non- 
Follow  Through  classrooms  (the  lowest  quintile)  had  a  mean  of  zero. 
No  Bank  Street  site  had  a  mean  of  zero.  ' 


Table  41 

SMALL  GROUP  OF  CHILDREN  INDEPENDENT  (Variable  116)-- -BANK  STREET 


Sites 


Brat  tleboro ,  Vermont 
Fall  River,  Mass. 
NYC  P.S.  243K 
Philadelphia  II,  Pa. 
Tuskegee,  Ala. 

Total  classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


1 
4 
2 
2 
1 

10 


2 
1 

1 

1 
1 


Percent  of  class- 
rooms 


21%    26%    53%  11% 


11%    32%  47% 
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Table  42 


ADUlT  open-ended  questions  to  children  (Variable  452a)~BANK  STREET 


First  Grade  Classrooms      Third  Grade  Classrooms 
wi ch  Implementation  wi th  Implementat ion 

Scores  of  Scores  of 


Sites 

I_  _2_ 

3 

1 

5  1 

2 

3 

4 

5 

Brattleboro,  Vermont 

1 

2 

1 

2 

Fall  River,  Mass. 

1 

^ 

-J 

2 

NYC  P.S.  243K 

1 

1 

2 

1 

1 

2 

Philadelphia  11,  Pa. 

1 

1 

2 

1 

2 

1 

luskegee,  Ala. 

2 

2 

2 

1 

J— 

Total  classrooms 

4 

1 

8 

6 

4 

7 

3 

5 

Percent  of  class- 

rooms 

21% 

32% 

21% 

37% 

167. 

0^,7 

Table  43 

CHILD  QUESTIONS  TO  ADULT  (Variable  350a)— BANK  STREET 

First  Grade  Classrooms      Third  Grade  Classrooms 
with  Implementation  with  Implementation 

Scores  of  Scores  of 


Sites 

1 

2 

3 

4 

5 

1 

2 

4 

Brattleboro,  Vermont 

1 

2 

3 

Fall  River,  Mass. 

1 

2 

1 

4 

.\'YC  P.S.  24 3K 

3 

1 

3 

1 

Philadelphia  II,  Pa. 

2 

1 

1 

Tuskegee,  Ala. 

\_ 

1 

2 

_]__ 

1 

_2_ 

Total  classrooms 

3 

1 

4 

5 

6 

8 

2 

2 

7 

Percent  of  class- 

rooms 

16% 

5% 

21% 

26% 

32% 

42% 

11% 

11% 

37% 
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e,      Sunimary  of  Implementation 


For  the  most  part,  Bank  Street  sites  do  not  differ  very 
much  from  each  other  in  the  degree  of  implementation.     The  greatest  dif- 
ference is  seen  in  the  third  grade  where  Tuskegee  and  Brattleboro  have 
scores  of  73  and  Philadelphia  has  a  score  of  64.     The  variance  among  sites 
is  not,  however,  greater  than  the  variance  within  sites.     The  greatest 
within  site  variation  is  found  in  Fall  River  first  grades  and  Tuskegee 
third  grades.     Overall  the  Bank  Street  classrooms  do  differ  significantly 
from  Non-Follow  Through  classrooms  (with  the  excei  .ion  of  Philadelphia 
third  grades) . 

A  study  of  observer  accuracy  for  Bank  Street  indicates 
that  m  general  the  codes  which  form  the  variables  used  in  this  section 
were  acceptably  reliable  (see  Appendix  L,  Table  L-S) •     There  is  one  ex- 
ception.    The  third  grade  observer  from  Fall  River  had  difficulty  coding 
direct  questions  from  the  videotape.     This  is  reflected  in  the  fact  that 
all  Fall  River  third  grades  are  ir  the  first  quintile  on  a  variable  which 
uses  this  code  (see  Table  43). 

The  reader  is  reminded  that  a  sponsor* s  implementation 
is  evaluated  in  two  ways:     (1)  Do  sponsor's  classrooms  differ  from  the 
traditional  classroom?  and  (2)  Are  a  given  sponsor^s  classrooms  similar 
to  each  other  in  level  of  implementation?    The  classrooms  differ  5  points 
from  Non-Follow  Through  in  17  out  of  19  first  grades  and  13  out  of  19 
third  grades.    Those  instances  of  low  classroom  implementation  scores  are 
scattered  over  several  sites.    An  analysis  of  variance  indicated  that  the 
difference  between  sites  is  not  greater  than  the  difference  within  sites. 
Fall  River  first  grades  and  Tuskegee  third  grades  evidenced  the  most 
variance  within  sites. 

4.      Fnglemann-Becker  Model  for  Direct  Instruction, 
University  of  Oregon 

a.      Description  of  the  Model 

The  Englemann-Becker  model  is  a  highly  structured  academic 
program  based  on  the  premise  that  with  proper  instruction  and  consistent 
reinforceme.it,  any  child  can  master  the  skills  necessary  to  bring  him  up 
to  the  achievement  level  of  national  norms  for  his  age  group. 

The  model  uses  programmed  reading,  math,  language,  and 
science  materials  which  they  have  deveJoped.     Highly  specific  methods 
are  used  to  teach  concepts  and  skills  required  for  mastering  sequenced 
tasks  orienced  toward  an  increasing  level  of  competence.     Desired  be- 
haviors are  systematically  reinforced  by  praise  and  enthusiastic  acknowl- 
edgment.   Teachers  and  students  share  the  pleasure  of  each  other's 
achievements.     Unproductive  or  antisocial  behavior  is  ignored  or  stopped 
by  a  short  reprimand.     Ignoring  is  intended  to  withdraw  from  the  behavior 
the  attention  that  often  reinforces  it.     When  this  is  true,  ignoring 
will  eventually  extinguish  the  behavior. 
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The  classroom  is  usually  staffed  with  two  or  three  adults 
(regular  teacher  and  one  or  two  full-time  aides  recruited  from  the 
Follow  Through  parent  community)  for  every  25  to  30  children.     Each  adult 
has  been  carefully  trained.     In  most  cases  the  adults  teach  a  single 
subject.    Working  very  closely  with  a  small  or  large  group  of  children, 
each  teacher  and  aide  uses  the  programmed  materials  in  cotubination  with 
predefined  teaching  strategies.     A  task  is  presented  hy  the  teacher. 
A  demonstration  is  usually  given  and  performance  ot  the  task  by  the  chil- 
dren is  tested.     When  the  children  respond  she  provides  immediate  feed- 
back.    She  proceeds  only  when  each  child  is  successful  with  a  given  in- 
structional unit.     When  the  children  have  completed  their  lessons  with 
one  adult,   they  proceed  to  their  next  subject  with  a  different  adult. 

b.      Description  of  the  Sites 

The  University  of  Oregon  project  sites  are  East  St.  Louis, 
Illinois;  New  York  City;  Racine,  Wisconsin;  Tupelo,  Mississippi;  and 
Providence,  Rhode  Island,     Demographic  and  other  information  describing 
the  five  communities  in  which  the  University  of  Oregon  projects  are 
located  (taken  from  U.S.  Census  Bureau  reports  and  Follow  Through  sources) 
is  shown  in  Table  44. 

Tupelo  is  the  only  one  of  the  University  of  Oregon  proj- 
ect sites  in  this  study  that  is  located  outside  of  a  metropolitan  area; 
it  is  also  the  only  University  of  Oregon  site  that  has  a  higher  percent 
of  adults  in  the  community  who  have  completed  high  school  than  the  Fol- 
low Through  sample  average. 

Racine's  $10,526  median  family  income  is  higher  than  the 
other  University  of  Oregon  sit^     and  is,  in  fact,  higher  than  any  other 
site  in  the  observ  .tion  sample;  its  6.6%  of  families  below  poverty 
level*  is  among  the  lowest  over  all  sites. 

The  East  St.  Louis  median  family  income  of  $6,654  is 
among  the  lowest  in  the  sample,  and,  similarly,  the  28.5%  of  families 
below  the  poverty  level  is  one  of  the  highest  percentages  in  the  sample. 
The  nonwhite  population  of  East  St.  Louis  is  69.3%,  a  considerably  high- 
er percentage  than  all  but  one  of  the  project  sites  in  the  Follow  Through 
sample. 

New  York  City  is  the  only  largo  city  in  the  University 
of  Oregon  sample.     Its  $9,682  median  family  income  is  above  the  sam;  le 
averat*e  and  its  11.5%  of  below  poverty  level  families  is  about  average 
compared  to  the  other  sites.     New  York  City's  nonwhite  population  of 
23.4;<;  is  slightly  above  the  average  for  all  Follow  Through  sites.'  It 
should  be  noted  that  this  figure  reflects  all  of  New  York  City:     The  Uni- 
versity  of  Oregon  classrooms  in  New  York  are  95%  black  (see  Tables  3  and  4). 

*The  U.S.  Census  Bureau  uses  the  U.S.  Office  of  Economic  Opportunity's 
poverty  index  guidelines  to  establish  povei"*'y  level. 
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Table  AA 


SITE  AND  DEMOGRAPHIC  DATA  FOR  UNIVERSITY  OF  OREGON  SITES 


A.    Geographic  Data 

Site  Location 


Site 

Code   

0703  E.  St.  Louis,  111. 

0707  New  York  City, 

P.S.  137K 

0708  Racine,  Wis. 

0711  Tupelo,  Miss. 

0719  Providence,  R.I. 


Region 


Metropolitan  Population 
Status  (1^  0  census) 


West  North  Cen-    Medium  city 
tral 

Middle  Atlantic    Big  city 

East  North  Cen-  Medium  city 
tral  ^ 

East  South  Cen-  Small  city 
tral 

North  East  Medium  city 


69,996 
7,894,798 
95,162 
20,A71 
179,213 


Demographic  Data  for  Total  Population 

Median  Parcent  of  Percent  of 

Family  Families  Below  Population 

Site  Name        Income  Poverty  Level  Nonwhite 

$  6,654  28.5%  69.3% 

9,682  11.5  23.4 

10,526  6.6  11.0 

8,436  12.5  17.6 

8,430  13.3  10.0 


E.  St.  Louis 
N'.C  P.S.  137K 
Racine 
Tupelo 
Providence 


Average  for 
all  sites 


$  8,631 


13.9% 


20.7% 


Percent  of 
Adults  Over  25 
Who  Finished 
High  School 

29.4% 

46.9 

49.5 

58.9 

40.6 

49.7% 


C.     Characteristics  of  the  Follow  Through  Evaluation  Sample 

  —    ^^TJj    " 

at  the  Site  for  First  Grade 

'         '  Average  Percent  with  A\rerage 

Average  First  Language  Baseline 

Site  Name        with  Preschool        Other  than  English  Score 

0% 


E.   St.  Louis 
NYC  P.S.  137K 
Rac  ine 
Tupelo 
Providence 


47% 
43 
75 
63 
97 


2 
9 
0 
0 


29 


26 


"Not  within  Standard  Metropolitan  Statistical  Area  (SMSA) . 
Taken  from  the  Follow  Through  Roster;  represents  the  Follow  Through 
evaluation  sample . 


Sources:    U.S.  Bureau  of  the  Census,  1970;  SRI 
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Although  Providence  is  a  medium-sized  ciLy  in  a  metropol- 
itan setting,  demographic  d^ta  for  Provit  ^nce  look  surprisingly  like 
those  for  Tupelo  with  respect  to  median  family  income  and  percent  of 
families  below  poverty  level.     The  nonwhito  populations  of  the  two  sites 
differ  by  7.6Z,  yet  both  are  below  the  average  for  ail  project  sites, 

c ,  Sponsor  Implementation  Variables 

fables  of  all  the  critical  variables  selected  to  assess 
implementatio  i  of  the  University  of  Oregon  model  can  be  found  in  Appendix 
M,     The  tables  in  Appendix  M  describe  ^he  impleirentation  score  for  each 
variabJe  for  each  classroom.     As  described  in  thc^  methodology  section 
of  this  chapter,   the  final  selection  of  variables  was  made  on  the  basis 
of  sponsor  ratings  reported  in  the  Sponsor  Variable  Questionnaire.  The 
variables  selected  for  the  University  of  Oregon  mcdel  are  of  course 
limited  descriptors  of  the  program.     Many  piocess( s  and  procedures  im- 
portant to  t'ue  program  are  not  assessed  in  this  s  udy  of  implementation. 

How  the  implementation  scores  were  computed  is  also  de- 
scribed in  the  methodology  section  on  page  100.     Since  the  aim  of  the  spon- 
sors was  to  provide  programs  that  differ  in  specific  ways  from  traditional 
classrooms,   the  traditional  classroom  has  been  used  as  the  standard 
yardstick  to  measure  each  sponsor's  implementation.     Sixteen  critical 
variables  were  selected  for  first  grade  and  17  for  third  grade  by  Uni- 
versity of  Oregon  as  those  on  whien  they  would  expect  their  classrooms 
to  be  different  from  conventional  classrooms.     An  implementation  score 
of  3  would  indicate  the  classroom  was  in  the  middle  of  the  scale  for 
the  conventional  classrooms;  an  implementation  score  of  5  would  mean 
that  the  model  classrooms  were  in  the  uppermost  range  of  conventional 
classrooms-     A  selection  of  vari^,bles  designated  as  critical  by  the 
sponsor  are  discussed  in  the  text. 
• 

d .  Implementation  Findings 

Figure  28  and  Table  45  present  the  total  implementation 
scores  for  each  classroom  by  grade  level.     These  total  scores  were  com- 
puted by  adding  each  quintile  score  of  the  University  of  Oregon's  imple- 
mentation variables  and  dividing  by  the  total  maximum  score.     Thus,  an 
average  score  on  all  variables  was  computed.     The  scores  are  presented 
as  percentages.     Total  scores  for  Non-Follow  Through  classrooms  were  also 
computed  for  the  University  of  Oregon  implementation  variables.  Means 
and  standard  deviations  are  presented  in  Table  45  along  with  the  results 
of  one-tailed  t-tests,  comparing  Non-Follow  Through  classrooms  with 
classrooms  using  the  University  of  Oregon  model.     Table  45  presents  the 
analysis  of  variance  among  sites. 

As  the  t-test  on  Table  45  indicates  overall  the  Univer- 
sity of  Oregon's  classrooms  are  significantly  different  from  the  Non- 
Follow  Through  classrooms.     The  histograms  on  Figure  28  show  that  only 
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Table  45 

TOTAL  IMPLKMENFATION  SCORES  FOR  CLASSROOMS  BY  S nT:-*UN I VERSTTY 

OK  ORKGON 


F^rst  Grade 


sues 

Classroom  Scores 

Site 

Scores 

1 

2 

3 

4 

X 

S.D. 

E.   St.   Louis  (EK) 

76. 

2% 

62.5% 

76.2% 

75.0% 

72.5% 

6.7 

NYC  P.S.  137K  (EK) 

88. 

1 

90.0 

91.2 

90.0 

1.3 

Racine  (EK) 

72. 

5 

72.5 

71.2 

71.2 

71.9 

.7 

Tupelo  (El) 

80. 

0 

86.2 

87.5 

87.5 

85.3 

3.6 

Providence  (EK) 

72. 

5 

77.5 

72.5 

73.7 

74.1 

2.4 

Sponsor  Scores  (N= 

19): 

78.2% 

8.1 

NET  Scores  (N=35) : 

61.0 

10.7 

t  =  6.11 

p<  .001 

f  =  17.61 

p<  .001 


Third  Grade 


Classroom  Scores   Site  Scores 


Sites 

I 

2 

3 

4 

X 

S.D. 

E.   St.   Louis  (EK) 

76. 

5% 

62.4% 

78.8% 

87.1% 

76.2% 

10.3 

NYC  P.S.   137K  (EK) 

68. 

2 

81.2 

57.6 

69.0 

11.8 

Racine  (EK) 

71 . 

8 

62.4 

84.7 

85.9 

76.2 

11.2 

Tupelo  (El) 

87. 

I 

80.0 

90.6 

74.1 

82.9 

7.3 

Providence  (EK) 

75. 

0 

82.4 

78.8 

69.4 

76.4 

5.5 

Sponsor  Scores  (N= 

19): 

76.5% 

9.3 

NFT  Scores  (N=36) : 

60.4 

10.5 

t  =  5.62 
p<  .001 
f  =  .91 

p  <  NS 
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one  Oregon  tirst  grade  has  a  score  lower  than  70  while  25  Non-Follow 
Through  classrooms  have  scores  lower  than  70.     In  the  third  grade  only 
one  Oregon  classroom  scored  below  the  mean  of  Non-Follow  Through, 

The  anaJLysis  of  variance  indicates  that  the  among-site 
variance  is  greater  than  the  within-site  variance  in  the  first  grade. 
In  the  third  grade  the  variance  is  as  great  within  sites  as  among  sites. 
The  difference  in  New  York  is  particularly  great  where  one  third  grade 
has  a  low  score  of  57,6  and  another  has  a  high  score  of  81,2,    A  possi- 
ble explanation  may  be  that  children  in  University  of  Oregon's  New  York 
third  grades  have  had  fewer  months  in  Follow  Through  and  the  attrition 
rate  is  greater  (see  Table  4,  p.  15).     The  standard  deviation  for  third 
grades  in  St.  Louis  and  Racine  is  also  high.     The  standard  deviation 
for  the  firsn  grades  at  these  same  sites  is  considerably  less.     This  dif- 
ference between  the  grades  might  be  explained  by  the  fact  that  in  the  spring 
of  the  year  in  third  grade  when  observations  are  conducted  teachers  are 
beginning  to  prepare  the  children  for  the  fourth  grade  Non-Follow  Through 
cliissrooms  and  they  might  not  be  adhering  so  strictly  to  University  of 
Oregon's  stated  program. 

Scores  for  each  critical  implementation  variable  for  each 
University  of  Oregon  site  and  classroom  are  presented  in  Appendix  M, 
Table  M-5  in  tabular  form.     The  tables  are  prepared  so  that  the  number 
of  teachers  receiving  a  particular  implementation  score  is  entered  in  a 
column.     The  number  of  teachers  from  each  site  is  entered  in  the  rows. 
The  total  number  of  teachers  receiving  a  particular  implementation  score, 
as  well  as  the  percentage  computed,  is  entered  on  the  bottom  rows.  Only 
a  few  critical  variables  will  be  discussed  in  this  text. 

The  University  of  Oregon  program  emphasizes  the  develop- 
ment of  basic  skills  in  reading  and  computation.     Findings  presented  in 
Table  46  indicate  that  90%  of  the  first  grade  classrooms  in  the  Univer- 
sity of  Oregon  program  often  engage  in  arithmetic  activities  and  are  on 
the  upper  end  of  the  scale  when  compared  with  traditional  classrooms. 
While  three  third  grade  classrooms  in  East  St.  Louis  and  four  classrooms 
in  Tupelo  have  the  highest  implementation  score,  all  but  one  third  grade 
classroom  in  other  sites  are  scattered  across  scores  2,  3,  and  4.  It 
must  be  noted  that  Tupelo  is  a  site  where  children  entered  school  in  the 
first  grade  while  at  all  other  sites  the  children  entered  school  in  kin- 
garten.     (The  reader  is  reminded  that  the  data  for  this  variable  in  third 
grade  was  not  very  stable  from  day  to  day,  see  Table  5,  p.  54.) 

As  shown  in  Table  47,  63%  of  University  of  Oregon's  third 
grade  classrooms  received  the  highest  implementation  score  of  5  in  read- 
ing and  language  development.     The  first  grade  implementation  scores  are 
scattered,  with  47%  obtaining  a  score  of  3.    This  indicates  that  while 
first  grades  differ  more  from  the  traditional  classrooms  in  how  often 
children  engage  in  math,  the  third  grades  differ  more  from  the  tradi- 
tional classrooms  in  how  often  the  children  engage  in  reading. 

For  instructional  purposes.  University  of  Oregon  children 
are  placed  in  small  groups.     Findings  presented  in  Tables  48  and  49  in- 
dicate that  both  teachers  and  aides  in  University  of  Oregon  first  and 


148 


Table  46 


NUMBERS,  MATH,  ARITiLMETlC  (Variable  66)— UNIVERSITY  OF  OREGON 


Sites 


E.  St.  Louis,  III, 
N\'C  P.S.  137K 
Racine,  Wis. 
Tupelo,  Miss. 
Providence ,  R.I. 

Total  class- 
rooms 


First  Grade  Classrooms 
with  Implementation 

Scores  of 
1      ~1  3 


4 
3 

0 

3 
2 

14 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


Percent  of 
classrooms 


11% 


16%  74% 


16%    32%    11%  42% 


Table  47 

READING,  ALPHABET,  LANGUAGE  DEVELOPMENT  (Variable  67)— UNIVERSITY 

OF  OREGON 


Sites 


E.   St.  Louis,  111. 
NYC  P.S.  137K 
Racine,  Wis. 
Tupelo,  Miss. 
Providence,  R.T. 

Total  class- 
rooms 

Percent  of 
classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


1 

4 
4 


Third  Grade  Classrooms 
with  Implementation 

 Scores  of  

1        2        3        4  5 

1111 


4 
3 

12 


11%    47%    16%    26%      5%      5%      5%    21%  63% 
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Table  48 


TEACHER  WITH  SMALL  GROUP  (Variable  88) —UNIVERSITY  OF  OREGON 


Sites 


E.  St.  Louis,  111. 
N\X  P.S.  137K 
Racine,  Wis. 
Tupelo,  Miss. 
Providence,  R.I. 

Total  class- 
rooms 

Percent  of 
classrooms 


First  Grade  Classroors 
wi th  Implementation 
Scores  of 


3 

2 

4 
4 

17 


Third  Grade  Classrooms 
with  Implement at  ion 
Scores  of 


12 


5% 


57    89%    16%      5%      5%    11%  63% 


Table  49 

AIDE  VI  :H  s:1ALL  group  (variable  94)— UNIVERSITY  OF  OREGON 


Sites 


E.  St.  Louis,  111, 
NYC  P.S.  137K 
Racine,  Wis. 
Tupelo,  Miss. 
Providence-,  R.I. 

Total  class- 
rooms 

Percent  of 
classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


1 


2 
2 

4 
4 

3 


1        3  15 
5%    16%  79: 


Third  Grade  Classrooms 
wiu  *  Implementation 

 Scores  of  

1^  3        4  5 


4 
1 
i 
4 
3 

13 


5%    26%  68% 
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Of  the  No.i-Follow  Through  classrooms,  20%  in  the  first  grade  (the 
lowest  quintile)  had  a  mean  of  zero  and  40%  in  the  third  grade  (the 
two  lowest  quintiles)  had  mean  of  zero.     No  University  of  Oregon  site 
had  a  mean  of  zero. 
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third  grade  classrooms  work  more  o£ten  with  small  groups  of  children 
than  do  teachers  in  comparison  classrooms. 

In  general,  in  the  University  of  Oregon  program,  after 
adults  give  instructions  to  the  small  group,   they  then  ask  a  question 
regarding  the  information  given.     The  children  respond,  and  the  adult 
provides  immediate  feedback.     The  findings  for  the  variable  represent- 
ing this  instructional  pattern  are  dramatic  in  that  95%  of  the  first 
grades  and  100%  of  the  third  grades  obtained  the  highest  implementation 
score  (see  Table  50). 


Table  50 


CHILD  GROUP  RESPONSE  TO  ADULT  ACADEMIC  COMMANDS/REQUESTS 
OR  DIRECT  QUESTIONS'^  (Variable  363a)— UNIVERSITY  OF  OREGON 


Sites 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


E.  St.  Louis,  111. 
NYC  P.S.  137K 
Racine,  Wis. 
Tupelo,  Miss. 
Providence ,  R.I. 

Total  class- 
rooms 


4 
3 
3 

U 
18 


k 
3 
A 
4 
A 

18 


Percent  of 
classrooms 


5% 


95% 


100% 


The  sponsor  refers  to  this  as  "Direct  instruction." 


Adult  praise  is  used  systematically  when  the  child  re- 
sponse is  correct-     The  child  always  knows  immediately  if  his  answer  is 
right  or  wrong.     Table  M  indicates  that  first  grades  have  63%  and  third 
grades  have  79%  of  their  classrooms  in  the  fourth  and  fifth  quintile  on 
this  variable.     All  of  Racine's  classrooms  are  in  the  fifth  quintile. 
Only  the  classrooms  in  East  St.  Louis  appear  atypical  on  this  variable. 

Children  in  University  of  Oregon  classrooms  use  workbooks 
and  textbooks  designed  or  recommended  by  the  sponsor.     As  shown  in  Table 
52,  79%  of  the  first  grades  have  a  high  implementation  sco^re  of  k  or  ■ 
While  47%  of  the  third  grades  also  have  implementation  scores  of  5,  the 
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Table  51 

ALL  ADULT  PRAISE  TO  CHILDREN  (Variable  398a )~UNIVERSITY  OF  OREGON 


Sites 


E.  St.  Louis,  111. 
NYC  P.S.  137K 
Racine,  Wis. 
Tupelo,  Miss. 
Providence,  R. I • 

Total  class- 
rooms 


First  Grade  Classrooms 
with  Implementation 
Scores  cf 


4 
4 

1 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


2 
1 

1 

1 


1 
4 

2 
3 

10 


Percent  of 
classrooms 


11%    16%    11%    16%  47% 


16%      5%    26%  53% 


Table  52 

TEXTS,  WORKBOOKS /ACADEMIC  ACTIVITIES  (Variable  240) —UNIVERSITY 

OF  OREGON 

First  Grade  Classrooms      Third  Grade  Classrooms 
with  Implementation  with  Implementation 


Sites 


E.  St.  Louis,  111. 
NYC  P.S.  137K 
Racine,  Wis. 
Tupelo,  Miss. 
Providence ,  R.I. 

Total  class- 
rooms 


Scores  of 


Scores  of 


1 
1 


1 
1 

4 
3 


percent  of 
classrooms 


5%    16%    42%    37%    16%    13%      5%    21%  47% 
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other  classrooms  are  scattered  across  all  of  the  scores.     Only  Tupelo 
has  all  four  third  grade  classrooms  with  implementation  scores  of  5. 

e •       Suim^iary  oi    Lnplementat  ion 

The  reader  is  reminded  that  a  sponsor's  implementation  is 
evaluated  in  two  v;ays:     (1)  Do  they  differ  from  the  traditional  class- 
room? and  (2)  Are  a  given  sponsor's  classrooms  similar  to  each  other  in 
level  of  implementation?    Using  the  first  criterion  our  findings  indicate 
that  University  of  Oregon  classrooms  are  statistically  different  from  Non- 
Follow  Through  classrooms. 

By  the  second  criterion  the  first  grades  are  implemented. 
The  greatest  deviation  between  sites  is  found  in  New  York  City  (90%)  and 
Racine  (71%).     East  St.  Louis  where  one  first  grade  has  a  score  near  to 
that  of  Non-Follow  Through  has  the  greatest  within  site  variance.  Tn 
third  grade  while  all  classrooms  but  one  have  scores  higher  than  Non-Follow 
Through  classrooms,  there  is  great  deviation  within  and  among  sites.  One 
explanation  offered  is  that  the  teachers  have  altered  the  program  in  prep- 
aration for  the  next  year  in  Non-Follow  Through  fourth  grades. 

A  study  of  observer  accuracy  for  University  of  Oregon  in- 
dicates that  the  codes  which  form  the  variables  used  in  this  section 
were  acceptably  reliable.     (See  Appendix  L,  Table  L-4.) 

5^      Behavior  Analysis  Approach — University  of  Kansas 

a.      Description  of  the  Model 

The  University  of  Kansas  Behavior  Analysis  Approach  aims 
at  teaching  children  basic  skills  by  means  of  systematic  positive  rein- 
forcement of  desired  behavior.     The  model,  uses  a  token  exchange  system 
to  provide  an  immediate  reward  to  the  child  for  successfully  completing 
a  learning  task.     Earned  tokens  can  be  exchanged  later  for  special  activ- 
ities, such  as  participation  in  a  spelling  bee  or  a  game  of  musical 
chairs,  work  on  a  puzzle,  or  play  with  blocks  and  trucks.  Instruction 
(work  time)  and  special  activity  (spend  time)  altcrnv-^tc  throughout  the 
day,  with  the  amount  of  time  spent  on  instruction  inc/easing  as  the 
amount  of  reinforcement  needed  to  sustain  motivation  decreases. 

'lo  encourage  the  child  to  move  from  external  rewards  to 
self-motivated  behavior,  more  tokens  are  given  during  the  initial  stages 
of  learning  a  task  and  progress^-vely  fewer  are  given  as  the  child  gains 
skills  and  takes  pleasure  in  the  skill.     Similarly,  fewer  tokens  are 
given  as  the  child  progresses  through  the  grades. 

The  program  emphasizes  individualized  instruction  based  on 
sequent  ed  Karning  materials.     The  curriculum  materials  include  a  descrip- 
tion of  the  behavior  a  child  should  be  capable  of  at  the  end  of  a  learning 
sequence' ,  and  clearly  provide  criteria  for  judging  a  correct  response* 
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Small  groups  formed  for  reading  instruction  are  directed 
by  the  teacher.     A  full-time  trained  aide  provides  math  instruction. 
Spelling  and  handwriting  are  taught  by  another  aide.     Individual  tutor- 
ing is  provided  by  parent  aides.     Although  children  in  this  model  are 
in  small  groups,  they  receive  adult  attention  on  a  one-to-one  basis. 

The  curriculum  materials  also  provide  for  periodic  test- 
ing and  monitoring  of  achievement  gains.    A  system  of  careful  record 
keeping  allows  the  teacher  to  keep  a  close  watch  on  each  child's  prog- 
ress and  to  tailor  the  curriculum  to  each  child's  needs. 

b.  Description  of  the  Sites 

The  University  of  Kansas'  five  project  sites  are  New 
York  City;  Philadelphia;  Portageville,  Missouri;  Kansas  City,  Missouri; 
and  Louisville. 

Demographic  and  uLher  information  describing  the  commun- 
ities in  which  the  University  of  Kansas  Follow  Through  projects  are  lo- 
cated is  presented  in  Table  53.  Four  of  the  University  of  Kansas  sites 
are  classified  by  population  and  location  as  large  cities  in  metropoli- 
tan settings;  the  fifth  site,  Portageville,  is  classified  as  outside  of 
a  metropolitan  area  (its  population  is  only  3,000  and  it  is  located  in 
southeast  Missouri). 

V/hile  the  four  metropolitan  sites  show  only  slight  differ- 
ences in  median  family  income  and  percentages  of  below  poverty  level'^ 
families,  and  cluster  in  both  categories  around  the  sample  average, 
Portageville's  median  family  income  ($5,913)  and  its  30.4%  of  families 
below  poverty  level  distinguish  it  from  the  other  sites  and  from  the 
average  of  the  Follow  Through  sample. 

The  data  presented  for  the  nonwhite  population  indicate 
that  Philadelphia,  with  its  34.4%  o':  population  nonwhite,  is  consider- 
ably different  from  the  other  University  of  Kansas  sites.     However,  all 
of  the  sites  but  one  have  a  greater  percent  of  nonwhites  than  the  20.7% 
Follow  Through  average.     Four  of  the  five  sites  have  proportionately 
fewer  adults  over  25  who  have  completed  high  school  than  the  49.7%  aver- 
age for  the  Follow  Through  sites. 

c.  Sponsor  Implementation  Variables 

Tables  of  all  the  critical  variables  selected  to  assess 
implementation  of  the  University  of  Kansas  model  can  be  found  in  Appendix 


*The  U.S.  Census  Bureau  uses  the  U.S.  Office  of  Econo'nic  Opportunity 
poverty  index  guidelines  to  establish  poverty  level. 
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labie  53 


<^ITE  AND  DEMOGRAPHIC  DAlA  FOR  UXIVrRSTTY  OF  KANSAS  STTFS 


Site 

Metropol itan 

Popul at  ion 

Code 

Site  Location 

Region 

Status 

U970  census) 

0801 

New  York  Citv,  P.S. 

Middle  Atlantic 

Big  city 

7,894,798 

77X 

0803 

Philadelphia  VI ,  Pa. 

Middle  Atlantic 

Big  city 

1 ,948,609 

0804 

Portageville,  Mo. 

V.est  North  Cen- 

Town''' 

3,117 

tral 

0806 

Kansas  City,  Mo. 

Vest  North  Cen- 

Big city 

507,087 

tral 

0807 

Louisville,  Ky. 

Last  South  Cen- 

Big city 

361  ,472 

tral 

B.     Demographic  Data  for  Total  Populati 


on 


Site  Name 

NTC  P.S.  77X 
Philadelphia  VI 
Portageville 
Kansas  City 
Louisville 

Average  for 
all  sites 


Median        Percent  of 
Fami ly     Families  Below    Popul at  ion 
Income    Poverty  Level 


$9,682 
9,366 
5,913 
9,910 
8,564 

$8,631 


Percent  of 
Percent  of    Adults  Over  25 
Who  Finished 
High  School 


Nonwhite 


11.5% 

11.2 

30.4 

8.9 
13.0 


13.97 


23.4^ 
34.4 
18.1 
22.8 
24.  1 

20.77 


46.97 

39.9 

37.3 

55.9 

40.9 

49.77 


Characteristics  of  the  Follow  Through  Evaluation  Sample 
at  the  Site  for  First  Grade^ 


S  i te  Name 

NTC  P.S.  77X 
Philadelphia  VI 
Portageville 
Kansas  City 
Louisville 


Average  Percent 
with  Preschool 

647'; 

26 

53 

42 

56 


Average  Percent  with  Average 

First  Language  Baseline 
Other  t ha n  l-lng  1  i s h  Score 

36%  377 
0  28 

0  32 

1  27 
0  23 


Not  within  Standard  Metropolitan  Slatihtical  Arc-a  (SMSA) . 

TaK-n  from  the  Follow  Through  Roster;  represents  the  Follow  Through 
evaluat  ion  sample . 


Sources:     T.S.   Bureau  of  i\u   Census,   1970;  SRI 
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M.     The  tables  in  Appendix  M  present  the  implementation  scores  for  each 
variable  for  each  classroom.     i\s  described  in  the  methodology  section  of 
this  chapter,  the  final  selection  of  variables  was  made  on  the  basis  of 
sponsor  ratings  reported  on  the  Sponsor  Variable  Questionnaire.  'Ihe 
variables  selected  for  the  University  of  Kansas  model  are  of  couroe 
limited  descriptors  of  the  program.     Many  processes  and  procedures  im- 
portant to  the  program  are  not  v^ssessed  in  this  study  of  implementation. 
How  the  implementation  scores  were  computed  is  also  described  in  the 
methodology  section  on  page  100.     Since  the  aim  of  sponsors  was  tc  provide 
programs  that  differ  in  specific  ways  from  traditional  classrooms,  the 
traditional  classroom  has  been  used  as  the  standard  yardstick  to  measure 
each  sponsor's  implementation.    Seventeen  critical  variables  were  se- 
lected by  University  of  Kansas  as  those  on  which  they  would  expect  their 
classrooms  to  differ  from  conventional  classrooms.     An  implementation 
score  of  3  would  indicate  the  classroom  was  in  the  mid-range  of  conven- 
tional classrooms;  an  implementauion  score  of  5  would  mean  that  the  model 
classrooms  were  in  the  uppermost  range  of  conventional  classrooms. 

d.       Implementation  Findings 

Figure  29  and  Table  54  present  the  total  implementation 
scores  for  each  classroom  by  grade  level.     These  total  scores  were  com- 
puted by  adding  each  quintile  score  for  the  17  University  of  Kansas  im- 
plementation variables  and  dividing  by  the  total  maximum  score.  Thus, 
an  average  score  on  all  variables  vas  computed.     The  scores  are  presented 
as  percentages.     Total  scores  for  Non-Follow  Through  classrooms  were  also 
computed  for  the  University  of  Kansas  implementation  variables.  Means 
and  standard  deviations  are  presented  in  Table  54  along  with  the  results 
of  one-tailed  t-tests,  comparing  Non-Follow  Through  with  classrooms  using 
the  University  of  Kansas  model. 

The  t-test  presented  on  Table  54  indicates  that  the  Uni- 
versity of  Kansas  classrooms  are  different  from  the  Non-Follow  Through 
clai  .rooms.     Only  one  first  grade  Kansas  City  classroom's  implementation 
score  (64.7)  is  close  to  the  Non-Follow  Through  score  (62.4).     All  other 
University  of  Kansas  classroom  scores  are  in  the  70s,  80s,  or  90s. 
Histograms  presented  in  Figure  29  illustrate  how  slight  the  overlap  is 
between  the  scores  of  University  of  Kansas  classrooms  and  Non-Follow 
Through  classrooms.     The  analysis  of  variance  indicates  that  in  the  first 
grade  there  is  a  greater  difference  among  site  implementation  mean  scores 
than  there  is  within  sites.     Portageville  has  the  highest  mean  score 
(92.)  and  Kansas  City  the  lowest   (76.).     Kansas  City  also  has  the  great- 
est within-site  variance  (8.7).     The  one  classroom  mentioned  above  seems 
to  account  for  this  variance.     In  the  third  graue  the  among-site  and  the 
within-site  variance  are  very  similar.     The  greatest  variance  is  found 
between  the  two  classrooms  in  New  York.     The  least  variation  for  third 
grades  is  found  within  Kansas  City  and  Louisville.    These  sites  also 
have  high  implementation  scores. 
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Ai I  of  the  critical  variable  scores  for  each  University 
of  Kansas  site  and  classroom  are  presenred  in  Appendix  M,  Table  M-6  in 
tabular  form.     The  tables  are  pr*  pared  so  that  the  number  of  classrooms 
receiving  a  particular  imp  1 ementc tion  score  is  entered  in  a  column. 
The  classroom     ;ores  from  e<ich  site  lie  along  the  rows.    The  total  num- 
ber of  classruoms  receiving  a  particular  implementation  score,  as  well 
as  the  percentage  computed,   is  entered  on  the  bottom  rows.     Only  a  se- 
lection of  the  variables  which  were  designated  by  the  sponsor  as  critical 
will  be  discussed  in  the  text* 

University  of  Kansas  emphasizes  the  development  of  basic 
skills  in  reading  anc'.  arithmetic.     The  findings  on  children  involved  in 
arithmetic  (as  presented  in  Table  55)  indicate  that  first  grades  using 
the  University  of  Karsas  model  -core  higher  in  implementation  (72%  in 
the  fourth  and  fifth  percentile)  than  do  third  grades  (which  have  only 
UUo  in  the  fourth  and  fifth  percentile). 


Table  55 

NUMBERS,  MATH,  ARITHMETIC  (Variable  66)— UNIVERSITY  OF  KANSAS 


Sites 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


Third  Grade  Classrooms 

with  Implementation 
 Scores  of  


NYC  P.S.  77X 
Philadelphia  VI,  Pa. 
Portageville,  Mo . 
Kansas  City,  Mo. 
Louisville,  Ky. 

Total  classrooms 


1 

1  1 

3  1 

1  1 

2  2 


  _1 

2  5 


Percent  of  class- 
rooms 


28%    44%    28%    12%    35%    12%    29%  12% 


However,  in  reading  activities,  both  first  grade  and 

third  grades  have  high  implementation  scores  when  compared  with  Non- 

Follow  Through  classrooms  (see  Table  56).  Louisville,  in  fact,  has  all 
of  first  and  third  grade  classrooms  in  the  topmost  quintile. 


The  University  of  Kansas  program  assigns  children  to  small 
groups  which  rotate  from  the  teacher  to  the  instructional  aides  for  les- 
sons in  reading,  arithmetic,  spelling,  and  handwriting.    As  shoi^m  in 
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r.ible  54 


rOTAL  IMPLEMENTATION  SCORES  FOR  CLASSROOMS  BY  SITE— UNI VERS ITY 

OF  KANSAS 


Tirst  Grade 


Classroom  Scores  Site  Scores 


c>  I L es 

i 

9 

X 

c 

O 

n 
u  . 

NYC  P.S.   77X  (EK) 

75.0% 

81.3% 

% 

% 

78 . 1% 

4 

4 

Philadelphia  VI  (EK) 

78.8 

90 . 6 

82 . 4 

88.2 

85 . 0 

5 

4 

Portageville  (EK) 

96.5 

91.8 

90.6 

88.2 

91.8 

3 

.5 

Kansas  City  (EK) 

82.4 

74.1 

83.5 

64.7 

76.2 

8 

.7 

Louisville  (EK) 

85.9 

90.6 

92.9 

85.9 

88.8 

3 

.5 

Sponsor  Scores  (N= 

18): 

84 .  6% 

7 

.9 

NET  Scores  (N=35)  : 

62.4 

8 

.5 

t  =  9. 

22 

P  <  • 

001 

f  =  5. 

14 

P  <  . 

01 

Third  Grade 


Classroom  Scores  Site  Scores 


Sites 

1 

3 

4 

X 

S 

.D. 

NYC  P.S.  7  7X 

(EK) 

71 

.2% 

85 

0% 

X 

% 

78 

1% 

9 

.7 

I^hiladelphia  VI 

(EK) 

76 

.5 

82 

4 

75.3 

84.7 

79. 

7 

4 

5 

Portageville 

(EK) 

89 

.4 

74 

1 

78.8 

80. 

8 

7 

8 

Kansas  City 

(EK) 

88 

.2 

88 

2 

84.7 

84.7 

86. 

5 

2 

.0 

Louisville 

(EK) 

88 

.  2 

91 

8 

87.1 

85.9 

88 

2 

2 

.5 

Sponsor  Scores 

(N=I7) 

83. 

3% 

6 

0 

NFT  Scores  (N= 

36)  : 

61. 

3 

9 

3 

t  =  8.89 
P  <  .001 

f  =  2.  53 

p  <  NS 
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Table  56 


READING,  ALPHABET,  LANGUAGE  DEVELOPMENT  (Variable  67)— 
UNIVERSITY  OF  KANSAS 


Sites 


First  Grade  Classrooms 
wit  .1  Implementation 
Scores  of 


Third  Grade  Classrooms 
with  Implementation 
Scores  of  


NYC  P.S.  77X 
Philadelphia  VI,  Pa. 
Portageville,  Mo . 
Kansas  City,  Mo. 
Louisville,  Ky. 

Total  clacrsrooms 


1 

1 


12 


Percent  of  class- 
rooms 


6%    11%      6%    13%  67% 


6%    12%    29%  53% 


Table  57,  all  ot  the    irst  grade  classrooms  received  an  implementation 
score  of  A  or  5  on  the  variable  '^Teacher  with  small  group"  and  88%  of 
the  third  grade  classrooms  had  a  score  of  A  or  5  on  this  variable. 


Table  57 

TEACHER  WITH  ^MM.L  GROUP  (Variable  88)— UNIVERSITY  OF  KANSAS 


Sites 


First  Grade  Classroor., 
wi  ch  Impleir.encation 
Scores  of 


'^hird  Grade  Classrooms 
with  Implementation 
Scores  of 


NYC  P.S.  77X 
Philadelphia  VI  Pa. 
Portageville ,  Mo. 
Kansas  City,  Mo. 
Louisville,  Ky. 

Total  classrooms 


1 
1 
A 
3 
A 

13 


2 
2 
2 
A 
A 

lA 


Percent  of  class- 
rooms 


237.  72% 


6% 


6%      6%  82% 


160 


On  Variable  94  (Aide  with  small  group)  all  first  and  third 
grade  classrooms  scored  4  or  5  (see  Table  58).     In  fact,  all  of  New  York 
City,  Portageville,  Kansas  City,  and  Louisville's"  third  grade  classrooms 
have  the  highest  possible  implementation  scores  (5) • 


Table  58 

AIDE  WITH  SMLL  CROUP  (Variable  94)-  .NI\ERSTTV  OF  KANSAS 


First  Grade  Classrooms      Thir<^  Grade  Classrooms 

with  Implementation  with  Implementation 
 Scores  of   Scores  of 


Sites                    I'*  2 

3  4 

5 

1*      2="      3  4 

5 

NTC  P.S.  77X 

2 

2 

Philadelphia  VI,  Pa. 

3 

1 

1 

3 

Portageville ,  Mo. 

4 

3 

Kansas  City,  Mo. 

A 

4 

Louisville,  Ky . 

4 

4 

Total  Classrooms 

3 

15 

1 

16 

Percent  of  class- 

rooms 

17% 

83% 

6% 

94% 

Of  the  Non-Follow  Through  classrooms,  20%  of  the  first  grade  (the  low- 
est quintile)  had  a  mean  of  zero  and  40%  o2  the  third  grade  classrooms 
(the  two  lowest  quinliles)  had  a  mean  of  zero.     No  University  of  Kan- 
sas site  had  a  mean  of  zero. 


Within  the  small  group,  the  adultf;  focus  their  attention 
upon  one  child  at  a  time.    As  shown  in  Table  59,  89%  of  che  first  grades 
ha^/e  an  implementation  score  of  4  or  5  for  Variable  438a,     In  the  third 
grade,  88%  of  the  classrooms  have  implementation  scores  of  5.  Again, 
New  York  City,  Portageville,  Louisville,  and  Kansas  City  third  grada 
classrooms  all  have  an  implementation  score  of  5.    This  is  remarl  ible 
when  one  considers  the  diver^jity  of  the  site  characteristics  (see  Table 
53), 

In  addition,  the  data  presented  in  Table  60  support  the 
finding  that  adults  and  children  interact  on  a  one-to-one  basis.  Note 
that  78%  of  the  first  grades  and  65%  of  the  third  grades  are  in  the 
fourth  and  fifth  quintiles  on  Variable  344a,  which  describes  the  indi- 
vidual child's  verbal  interaction  with  adults*     New  York  City  has  all 
of  its  classrooms  in  the  fifth  ciintile. 
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Table  59 


ADULT  COM>!UNICATION  OR  ATTENTION  FOCUS,  ONE  CHILD 
(Variable  438a)"-UNIVERSITY  OF  KANSAS 


Sites 


NYC  P.S.  77X 
Philadelphia  VI,  Pa. 
Portageville,  Mo. 
Kansas  City,  Mo. 
Louisvilln,  Ky. 

Total  classrooms 


Fir:;t  Grade  Classrooms 
with  Imp] ementat ion 
Scores  of 


1 
2 
4 
1 

12 


Percent  of  class- 
rooms 


11% 


22%  67% 


6% 


6% 


Table  60 

INDIVIDUAL  CHILD  VERBAL  INTERACTIONS  WITH  ADULT 
(Variable  3A4a)~UNTVERSITY  OF  KANSAS 


Sites  1        2        3  4 


NYC  P.S.  77X 
Philadelphia  VI,  Pa. 
Portageville,  Mo. 
Kansas  City,  Mo, 
Louisville,  Ky. 

Total  classrooms 

Percent  of  class- 
rooTn's 


First  Grade  Classrooms 
with  Implementation 

Scores  of  

5 


2 

2        1  1 
4 

2  1  1 
    J_ 

4        2  12 


22%    11%  67% 


Third  Grade  Classrooms 
with  Implementation 

Scores  of  

5 


7 
2 
3 
4 

15 


88% 


Third  Grade  Classrooms 
with  Implementation 

Scores  of   

1        2        3        4  5 


2 

1        2  1 

1  2 
1  3 
1        1  2 

15        2  9 


6%    29%    12%  53% 
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The  aduiL  provides  Lhe  group  with  a  bit  of  information 
and  then,  on  a  one-to-one  basis,  the  adult  asks  a  child  a  question  about 
the  information.     The  child  responds,  and  the  adult  provides  the  child 
with  inimediaLe  feedback.     The  results  for  this  interaction  pattern  are 
presented  in  Table  61.     Seventeen  of  the  18  first  grade  classrooms  at- 
tained an  implementation  score  of  5.     Twelve  of  the  17  third  grade  class- 
rooms had  implementation  scores  of  5.    Again,  Louisville  and  Kansas  City 
have  all  of  their  classrooms  attaining  a  high  implementation  score  of  5. 


Table  61 


ADULT  FEEDBACK  TO  CHILD  RESI'ONSE  TO  ADULT  ACADEMIC  COI'IMANDS,  REQUESTS, 
OR  DIRECT  QUESTIONS  (Variable  412a)~UNIVEPSITY  OF  KANSAS 


Sites 


NYC  P.S.  77X 
Philadelphia  VI,  Pa. 
Portageville,  Mo 
Kansas  City,  Mo. 
Louisville,  Ky. 

Total  classrooms 


First  Grade  Classrooms 
wi Lh  Implementation 
Scores  of 


2 
3 
4 
4 

4 

17 


Third  Grade  Classrooms 
with  Implementatioa 
Scores  of 


1 
2 
1 
4 
4 

12 


Percent  of  class- 
rooms 


94^ 


6%      6%    18%  71% 


The  reinforcement  provided  for  correct  responses  and  be- 
havior during  ''work  time"  is  in  uhe  form  of  tokens.     These  tokens  can 
later  be  exchanged  for  some  activity  the  child  desires.     Table  62  pre- 
sents the  findings  for  this  variable.     In  the  first  grade,  all  18  class- 
rooms have  implementation  scores  of  5.     In  the  third  grade,  all  class- 
rooms have  implementation  scores  of  either  ^  or  5.    As  mentioned  in  the 
methodology  section,  a  classroom  could  be  given  a  score  of  4  even  if  the 
mean  is  zero.     In  this  case,  in  the  third  grade  the  mean  for  New  York 
City,  Portageville,  and  Kansas  City  is  zero,  indicating  that  tokens  are 
not  'ised  in  the  third  grade  at  these  sitei  .     However,  at  Philadelphia 
and  Louisville,  tokens  are  used  in  third  grade,  and  with  the  same  fre-- 
quency  as  in  first  grade  (see  Appendix  0  for  means  and  standard  devia- 
tion) . 

After  the  "earn  time,"  University  of  Kansas  classrooms 
have  a  "spend  time,"  so  that  children  car  spend  the  *:okens  they  have 


163 


Table  62 


ALL  ADULT  REINFORCEMENT  WITH  TOKENS  (Variable  469a)— -UNIVERSITY 

OF  KANSAS 


First  Grade  Classrooms      Third  Grade  Classrooms 
with  Implementation           with  Implementation 
Scores  of     Scores  of  


Sites  1* 

2*      3*      4        5        1*  2'- 

3*  4 

5 

NYC  p.s.  iiy 

2 

2 

Philadelphia  VI,  Pa. 

4 

4 

Portageville ,  Mo. 

4 

3 

Kansas  City,  Mo. 

4 

4 

Louisville,  Ky. 

_4 

_1 

Total  classrooms 

18 

10 

1 

Percent  o£  class- 

rooms 

1007. 

59% 

41% 

Of  the  Non-Follow  Through  classrooms,  60%  (the  three  lowest  quintiles) 
had  a  mean  of  zero  in  both  first  and  third  grades.     No  University  of 
Kansas  site  had  a  mean  of  zero. 


earned  during  academic  instruction.    As  presented  in  Table  63,  88%  of  the 
first  grade  classrooms  have  implementation  scores  in  the  upper  ranges  of 
the  use  of  games  and  puzzles,  while  j9%  of  the  third  grades  are  in  the 
upper  range  on  this  variable. 

The  variable  "Child  task  persistence'*  (Table  64)  indi- 
cates that  self-instruction  is  cont.inuous  over  a  period  of  time  (as  in- 
dicated by  a  sequence  of  FMO  frames).     Of  the  15  third  grade  classrooms, 
14  have  high  implementation  scores  of  4  or  5,    The  implementation  scores 
of  the  first  grades  on  this  variable  are  not  -is  consistent  over  all  as 
those  in  the  third  grade, 

e.       Summary  of  Implementation 

The  results  of  other  implementation  variables  selected 
for  University  of  Kansas  may  be  found  in  Appendix  M,  Table  M-6.  Overall, 
University  of  Kansas  classrooms  are,  except  for  one  classroom,  at  the 
upper  end  of  the  scale  when  compared  to  the  Non-Follow  Through  class- 
rooms.   As  previously  mentioned,  both  grades  are  significantly  differ- 
ent in  total  implementation  scores  from  Non-Follow  Through,     In  addition, 
there  is  little  deviation  in  total  implementation  scores  witnin  sites 
or  among  sites  except  in  Kansas  City  first  grades  and  New  York  third 
grades.     Day-to-day  variability  reported  on  Table  5,  p.  54,  did  not  seem 
-adversely  affect  the  implementation  scores  ol  the  University  of  Kansas. 
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Table  63 


GUESSING  GAMES,  TABLE  GAMES,  PUZZLES  (Variable  65)--UNIVERSITY 

OF  KANSAS 


Sites 


NYC  P.S.  77X 
Philadelphia  VI,  Pa. 
Fortagev Llle ,  Mo. 
Kansas  City,  Mo. 
Louisville,  Ky. 

Total  classrooms 


First  Grade  Classrooms 

with  Implementation 
   Scores  


r 


11 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


Percent  of  class- 
rooms 


22%    17%  61% 


35%      6%    35%  lUX 


Some  40%  of  the  Non-Follow  Through  first  grade  classrooms  (the  two 
lowest  quintiles)  and  20%  of  the  third  grade  classrooms  had  a  mean  of 
zero.     No  University  of  Kansas  site  had  a  mean  of  zero. 


Table  64 

CHILD  TASK  PERSISTENCE  (Variable  513c)~UNIVERSi.TY  OF  KANSAS 


Sites 


First  Grade  Classrooms 
with  Implementation 

 Scores  of  

1        2        3        4  5 


'^'hird  Grade  Classrooms 
with  Implementation 
Scores  of 


N'YC  P.S.  77X 
Philadelphia  VI,  Pa. 
Portageville ,  Mo. 
Kansas  City,  Mo. 
Louisville,  Ky. 

Total  classrooms 


Perceni:  of  class- 
rooms 


25%    25%    13%  38% 


7%    47%  m 
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A  study  of  observer  accuracy  for  the  University  ot  Kansas 
indicates  that  in  general  the  codes  which  form  the  variables  used  in 
this  section  were  acceptably  reliable  (see  Appendix  L,  Table  L-5). 
Some  observers  did  !iave  difficulty  coding  f  edback  variables  from  the 
videotape  (New  York  and  Portageville  first  grade  observers  and  Kansas 
City  and  Louisville  third  grade  observers).     However,  data  from  all 
University  of  Kansas  sites  are  consistent  with  ea::h  other  regarding  the 
feedback  variables  used  in  this  section  (see  I'duies  61  and  62). 

The  reader  is  reminded  that  a  sponsor's  implementation  is 
evaluated  in  two  ways:     (1)  Do  the  classrooms  differ  from  the  traditional 
classroom?  and  (2)  Are  a  given  sponsor's  classrooms  similar  to  each  other 
in  level  of  implementation?    Using  these  criteria,  we  conclude  that  Uni- 
versity of  KansdS  would  be  able  to  implement  their  model  in  other  sites 
similar  to  the  ones  used  in  this  analysis. 

6.       Cognitively  Oriented  Curriculum  Model — High/Scope 

a.       Description  of  the  Model 

Derived  from  the  theories  of  Piaget  and  developed  through 
eight  years  of  research  with  disadvantaged  children,  the  Cognitively 
Oriented  Curriculum  model  provides  teachers  in  the  early  elementary 
grades  with  a  theoretical  framework  that  embraces  cognitive  goals,  a 
teaching  strategy,  and  suggested  materials. 

Five  cognitive  areas  are  emphasized:  classification, 
number,  causality,  time,  and  space.     The  curriculum  contains  a  carefully 
sequenced  set  of  goals  tiiat  enable  the  teacher  to  focus  on  the  develop- 
ment of  specific  thought  processes  perceived  as  essential  to  children's 
mental  growth. 

In  the  Cognitive  Curriculum,  the  teaching  of  basic  skills 
io  incorporated  into  the  drily  routine  and  is  an  integral  part  cf  the 
"plan,  work,  and  evaluate*  instructional  sequence.    There  are  a  variety 
of  learning  centers  fron  which  children  can  choose  the  activities  that 
they  wish  to  pursue.     Each  day,  the  children  make  a  plan  for  their  activ- 
ities, follow  their  plan,  represent  or  evaluate  their  ac  ivity  in  some 
way.  and  discuss  what  they  have  done  in  a  group  setting.     The  develop- 
ment of  a  child's  reading,  writing,  and  computation  skills  are  expected 
to  be  a  natural  outgrowth  of  experiencing  events,  recording  the  events 
he  experiences,  and  transmitting  these  experiences  to  others. 

More  specif ica3 ly,  during  the  planning  period,  the  chila 
verbalizes  arA  th<^n  describes  in  writing  what  he  is  going  to  do  during 
work  timj.     Sometimes  he  makes  a  list  of  the  tuxngs  he  is  going  ro  use. 
The  teacher  helps  to  clarify  and  extend  his  thoughts  with  appropriate 
questions.     During  the  work  period,  the  child  carries  out  his  plan.  Hn 
may  involve  himself  directly  with  reading,  writing,  or  mata  activities 
by  reading  in  the  quiet  area  or  writing  a  otory  in  the  book-making  area; 
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or  he  may  involve  himself  indirectly  in  such  things  as  games,  construc- 
tion, and  dramatic  play.     Writing  and  drawing  during  ^'repicsentat ion" 
time  reciuires  the  child  to  think  about  what  he  has  done  and  to  record 
these  thoughts  in  some  way;   thus,   reading  and  writing  skills  are  devel- 
oped.    Language  skills  are  emphasized  during  evaluation  time  when  the 
child  verbalizes  the  inoughts  he  has  recorded  as  part  of  his  represen- 
tation. 

The  cognitive  approach  is  based  on  the  sponsor's  convic- 
tion that  a  child  must  initiate  his  own  learning.     In  order  to  promote 
such  child  initiative,  specific  instructional  processes  are  required 
of  High/Scope  teachers:     (1)  instruction  should  be  conducted  with  in- 
dividual children  and  small  groups;   (2)  children  should  engage  actively 
with  learning  materials;   (3)  teachers  should  be  good  listeners;  (4)  dis- 
cussions siiould  be  designed  to  encourage  speculation  and  evaluation; 
(5)  self-direction  should  be  encouraged;  and  (6)  verbal  interaction 
among  children  should  be  encouraged. 


b.       Description  of  the  Sites 

High/Scope's  five  project  sites  are  Greenwood,  Missis- 
sippi; Fort  Walton  Beach,  Florida;  New  York  City;  Greeley,  Colorado; 
and  Denver,  Colorado.     Demographic  and  other  information  describing 
the  five  communities  in  which  the  High/Scope  projects  are  located  is 
shown  in  Table  65. 

Three  of  the  sites   (Greenwood,  Fort  Walton  Beach,  and 
Greeley)  are  classified  as  small  cities  whereas  Denver  and  New  York  Gxty 
are  classified  as  large  cities.     Although  New  York,  Denver,  Greeley,  and 
Fort  Walton  Beach  differ  in  size,  other  demographic  data  for  the  four 
sites  show  similarities:     their  median  family  incomes  of  over  $9,000 
are  higher  than  the  Follow  Through  average,  their  percentages  of  below 
poverty  level'-^  families  and  nonwhite  population  (excepting  New  York)  are 
lower  than  the  average  for  Follow  Through^  and  their  percentages  of 
adults  over  25  who  have  completed  high  school  are  higher  than  the  Follow 
Through  sample  average.     New  Yc^rk  City  is  also  remarkably  like  them  ex- 
cept tliat  its  23.^%  nonwhite  population  is  higher  than  sample  average. 

Greenwood  provides  a  clear  contrast  to  the  other  four 
sites  in  all  cl  tiK'se  ireas:     i.s  median  family  income  of  $6,458  and 
its  44. 4Z  of  adults  over  2S  who  have  completed  high  school  are  consider- 
ably lov/er  than  the  othtr  High/Scope  projects,  as  well  as  being  lower 
than  che  average  over  all  Follow  Through  sites;  its  percentages  of  below 
poverty  level  families  and  nonwhite  population  are  considerably  higher 
Ih^a  the  other  High/Ccope  cites,  as  well  as  being  higher  than  the  over- 
all Follow  Through  average. 


nhe  r.S.  Census  Bureau  uses  U.S.  Office  oi  Economic  Opportunity  poverty 
index  guidelines  to  establish  poverty  jl.  -el. 


Table  65 


SITE  AXD  DEMOGRAPHIC  DATA  FOR  HIGH/SCOPE  SITES 


A .     Geographic  Data 

Site  Location 


Site 
Code 


Region 


Metropolitan 
Status 


0901    Greenwood,  Miss. 


East  South  Cen 
tral 

0902  Ft.  Walton  Beach,     South  Atlantic 

Fla. 

0903  iN'ew  York  City,. 

P.S.  92M 

0906  Greeley,  Colo.  Mountain 

0907  Denver,  Colo.  Mountaii. 


Small  city'^' 
Small  city" 
Middle  Atlar.tic     Big  city 


Small  city 
Big  city 


Popula*  ion 
( 1970  census) 

22,400 

19,994 

7,894,798 

38,902 
514,678 


B.     Demographic  Data  for  Tocal  Population 


Site  Name 


Greenwood 

Ft.  Walton  Beach 

NTC  P.S.  92M 

Greeley 

Denver 

Average  for 
all  sites 


Median 
Family 
Income 

$6,458 
9,950 
9,682 
9,091 
9,964 

$8,631 


Percent  of 
Families  Below 
Poverty  Level 

26.3% 
9.9 


11. 

9, 

9, 


13.9% 


Percent  of 
Population 
Nonwiiite 

50.4% 

9.4 
23.4 

1.6 
11.0 


20.7% 


Percent  of 
Adults  Over  25 
U^no  Finished 
High  School 

44.4% 

76.8 

46.9 

65.6 

61.5 

49.7% 


OS  of  the  Follow  Through  Evaluation  Sample 


Charac terist 

at  the  Site  i .  r  First  Grade 


Site  Name 


Greenwood 

Ft.  Walton  Beach 

NYC  P.S.  92M 

Greeley 

Denver 


Average  Percent 
with  Preschool 

39% 

90 

48 

56 

65 


Average  Percent  witti  Average 

First  Language  Baseline 

Other  than  English  Score 

1% 

1  18*** 

0  33 

25  31 

9  '  25 


Not  within  Standard  Metropolitan  Statistical  Area  (s>/iSA). 

Taken  from  the  Follow  Through  Roster;  represents  i.he  Follow  Through 
evaluation  sample. 

A  shorter  form  was  presented  in  the  entering  year,  thus  there  were 
fewer  items  and  lower  scores. 


Sources:    L.S.  Bureau  of  the  Census,   1970;  SRI 
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c .      Sponsor  Implementation  Variables 


Tables  of  all  the  critical  variables  selected  to  assess 
implementation  and  exportability  of  the  High/Scope  model  can  be  found 
in  Appendix  M.     Tiie  tables  in  Appendix  M  present  the  implementation 
score  for  each  variable  for  each  classroom.    As  described  in  the  method- 
ology section  of  this  chapter,  the  final  selection  of  variables  was  made 
on  the  basis  of  sponsor  ratings  reported  on  the  Sponsor  Variable  Ques- 
tionnaire.   The  variables  selected  for  High  Scope  are,  of  course,  limited 
descriptors  of  the  program.     Many  processes  and  procedures  important  to 
the  program  are  not  assessed  in  this  study  of  implementation.     For  ex- 
ample, we  cannot  observe  whether  in  fact  the  children  are  learning  to 
classify  objects  or  whether  they  are  developing  concepts  regarding  time 
and  space.     We  can  only  record  that  they  are  using  objects,  that  they 
are  engaged  in  activities  without  adults  present,  and  that  they  ask 
questions.     One  has  to  make  a  considerable  leap  from  these  variables  to 
the  sponsor's  stated  goals.     How  the  impl€,mentation  scores  ware  computed 
is  also  described  in  the  methodology  section  on  page  100.     Since  the  aim 
of  sponsors  was  to  differ  in  specific  ways  from  traditional  classrooms, 
the  traditional  classroom  has  been  used  as  the  yardstick  to  measure- each 
sponsor's  implementation. 

Twenty-nine  variables  were  selected  by  High/Scope  as  those 
on  which  they  would  expect  their  classrooms  to  differ  from  conventional 
classrooms.     An  implementation  score  of  3  indicates  that  the  classroom 
is  in  the  mid-irange  of  conventional  classrooms;  an  implementation  score 
of  5  means  that  the  model  classrooms  are  in  the  uppermost  range  of  con- 
ventional classrooms.     A  selection  of  variables  designated  as  critical 
are  discussed  in  the  text. 


d.       Implementatiog  Findings 

Figure  30  and  Table  66  present  the  total  implementation 
scores  for  each  classroom  by  grade  level.     These  total  scores  were  com- 
puted by  adding  each  quintile  score  of  High/Scope's  29  implementation 
variables  and  dividing  by  the  total  maximum  score.    Thus,  an  average 
score  on  all  variables  was  computed.     The  scores  are  presented  as  per- 
centages.    Totals  for  Non-Fcllow  Through  classrooms  were  also  computed 
for  the  High/Scope  implementation  variables.     Means  and  standard  devia- 
tions are  presented  in  Table  66  along  with  the  results  of  one-tailed 
t-tcsts,  comparing  Non-T^ollow  Through  with  High/Scope.     Table  66  presents 
the  analysis  of  variance  among  sites. 

The  t-test  presented  on  Table  66  indicates  that  overall 
the  High/Scope  implementation  mean  score  differs  from  Non-Follow  Through 
mean  score.     Only  the  classrooms  in  the  New  York  third  grades  have  im- 
plementation scores  similar  to  those  in  Non-Follow  Through.     No  expla- 
nation of  the  low  implemented  score  of  New  York  third  grades  is  readily 
apparent.     The  demographic  information  presented  on  Table  65  indicates 
that  the  primary  difference  in  New  York  and  the  other  Ib'gh/Scope  sites 

169 


50 


10 


O 


CO  JO 
< 


20 


10 


FIRST  GRADE 

□  FT,  N  18 

□  NFT,  \  Jb 


50 


60 


60 
65 


65 
70 


70 

;5 


75 

80 


80 
85 


85 
90 


50  ~ 


THIRD  GRADE 

□  f^T    ,>!  -  18 

□  NFT,  N  --  36 


^*0 


5 

O 
O 

a. 

CO 
< 

5 

2 


30 


?0 


^0 


bO 


55 
60 


60 
65 


65 
70 


70 
75 


75 
80 


80 
85 


85 
SO 


TOTAL  l\1PLEMrfvlTAT!0N  SCORE 


FIGURE  30      HISTOGRAM  SHOWING  IMPLEMENTATION  SCORES  FOR  HIGH  SCOPE 


Table  66 


rOlAL  IMPLEMENTA'lION  SCORES  FOR  CLASSROOMS  BY  SITE~H IGH/SCOPE 

First  Grade 


Classroom  Scores  Site  Scores 


Sites 

1 

2 

3 

4 

X 

S 

D 

Greenwood  (El) 

71.0% 

67  .6% 

70.3% 

76.6% 

71.4% 

3 

8 

Ft.  Walton  Beach(El) 

77.9 

73.8 

79.3 

75.9 

76.7 

2 

.4 

NYC  P.S.  92M  (EK) 

66.2 

71.7 

71.0 

69.7 

3 

0 

Greeley  (EK) 

82.8 

81.4 

82.8 

82.3 

.8 

Denver  (EK) 

86.9 

80.7 

80.7 

82.8 

82.8 

2 

.± 

Sponsor  Scores  (N= 

18): 

76.6% 

6 

.0 

NFT  Scores  (N=35):  63.7  5.8 


t  =  7.58 
p  >  .001 
f  =  15.59 
p  >  .001 


Third  Grade 


CJassroom  Scores  Site  Scores 


Sites 

1 

2 

3 

4 

X 

S 

D. 

Greenwood 

(El) 

70. 

3% 

73. 

1% 

75.2% 

74.5% 

73.  3% 

2 

1 

Ft.  Walton  Beach 

(El) 

83. 

4 

83. 

4 

80.7 

78.6 

81.6 

2 

3 

NYC  P.S.  92M 

(EK) 

66. 

9 

62. 

1 

64.8 

64.8 

64.7 

2 

0 

Grec-ley 

(EK) 

80. 

0 

80. 

0 

86.2 

82.] 

3 

6 

Denver 

(EK) 

I 

71. 

7 

78.6 

76.6 

75.0 

3_ 

o 

Sponsor  Scores 

(N=18) 

75.0% 

6 

9 

NFT  Scores  (N= 

36): 

63.5 

6 

8 

t  =  5 

93 

P  >  . 

001 

£  =  27 

34 

P  > 

001 
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is  geographic  in  nature  and  Table  4  indicates  that  the  children  are 
similar  to  those  of  other  sites.    Another  source  of  error  might  be  in 
the  observers,  however,  a  study  of  observer  accuracy  in  New  York  indi- 
cates that  the  codes  which  form  the  variables  for  High/Scope  were  accept- 
ably reliable  (see  Appendix  L,  Table  L-6).     The  histograms  presented  in 
Figure  30  show  that  approximately  50  percent  of  the  Non-Follow  Through 
first  grades  score  between  60  and  65  while  no  first  grades  in  High/Scope 
have  such  a  score.    The  analysis  of  variance  shows  that  although  it  is 
small,   the  vai^iability  among  sites  is  statistically  significant  relative 
to  the  within  site  variance  for  both  first  and  third  grades.     In  no  case 
is  the  within  site  variance  greater  than  3.8  (Greenwood  first  grades) 
and  in  Greeley  the  variance  between  first  grades  is  only  .8.     This  is 
remarkable  since  in  Greeley  27  percent  of  the  children  speak  English  as 
a  second  language  and  the  attrition  rate  is  high.     These  figures  reflect 
a  migrant  Spanish  speaking  population,  and  indicate  that  the  teachers  have 
been  able  to  implement  the  modal  where  the  differing  language  could  have 
presented  problems  in  communication  of  the  model.     In  spite  of  the  site 
demographic  differences  described  for  Greenwood  the  implementation  at  that 
site  appears  to  be  acceptable. 

Scores  for  each  implementation  variable  for  each  High/Scope 
site  and  classroom  are  presented  in  Appendix  M,  Table  M-7.     The  tables 
are  prepared  so  that  the  number  of  teachers  receiving  a  particular  imple- 
mentation score  is  entered  in  a  column.     The  teachers  of  each  site  are 
entered  in  the  rows.     The  total  number  of  teachers  receiving  a  particular 
implementation  score,  as  well  as  the  percentage  computed,  is  entered  on 
the  bottom  rows.     Only  a  few  critical  variables  will  be  discussed  in 
this  text. 

The  High/Scope  model  considers  it  important  that  children 
be  allowed  to  select  their  own  seating  and  group  for  part  of  the  time. 
As  presented  in  Table  G7,  56%  of  the  first  grades  and  53%  of  the  third 
grades  received  a  score  of  5  on  this  variable.     Fort  Walton  Beach  had 
all  of  their  classrooms  in  both  grade  levels  scoring  at  the  highest  level. 
New  York,  however,  had  all  of  their  first  and  third  grades  scoring  in 
the  second  quintile. 

The  High/Scope  model  encourages  teachers  to  provide  a 
wide  variety  of  activities  and  material  so  that  children  can  plan  their 
own  learning  schedule.     Findings  presented  in  Table  68  indicate  that  89% 
of  the  first  grades  and  79%  of  the  third  grades  have  high  implementation 
scores  of  4  and  5  on  Var.  83  (Wide  variety  of  activities,  over  one  day). 

High/Scope  classrooms  also  are  high  on  the  implementation 
scale  for  Var.  65  (Guessing  games,  table  games,  puzzles)  and  Var.  70 
(Sewing,  cooking,  pounding),  as  shown  in  Tables  69  and  70. 

As  presented  in  Table  71,  High/Scope  classrooms  are  low 
on  the  number  of  children  engaged  in  arithmetic  when  compared  to  Non- 
Follow  Through  children.     Arithmet  c  in  High/Scope  classrooms  is  often 
pursued  informally  and  it  is  possible  that  observers  may  have  missed 
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Table  67 


CHILD  SELECTION  OF  SEATING  AND  WORK  GROUPS 
(Variable  24)— HIGH/SCOPE 


S  i  tes 


Greenwood,  Miss. 
Ft.  Walton  Beach,  Fla. 
NYC  P.S.  92M 
Greeley,  Colo. 
Denver,  Colo. 

Total  classrooirs 

Percent  of  class- 
roon  s 


First  Gnade  Classrooms 
with  Implementat ion 

 Scores  of 

^1^      2        3  5 


3  1 

4 

3 

3 

 _3 

6       2  10 


Third  Grade  Classrooms 
with  Implementation 

 Scores  of  

1^^      2        3        4  ^ 


A 
4 

4 

1  2 

  _2_    J_  _ 

4       2        3  10 


33%    1 1%  56%  21%    11%    16%  53% 


In  Non-FoUow  Through,  20%  of  the  classrooms  (the  lowest  quint ile)  in 
both  first  and  third  grade  had  a  mean  of  zero.     One  High/Scope  site 
(NYC  P/S.  92M)  had  a  mean  of  zero  in  both  first  and  third  grade  class- 
rooms . 

Because  of  tied  scores  in  the  Non-Follow  Through  first  grade  class- 
ro'  IS,  no  High/Scope  classroom  could  be  given  a  score  of  4. 
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Table  68 


WIDE  VARIETY  OF  ACTIVITIES,  OVER  ONE  DAY  (Variable  83)~HIGH/SCOPE 


Sites 


Greenwood,  Miss. 
Ft.  Walton  Beach,  Fla, 
NYC  P.S.  92M 
Greeley,  Colo. 
Denver,  Colo. 

Total  Classrooms 


First  Grade  Classrooms 
wi th  Implementation 
Scores  of 


2 
3 
2 
1 
3 

11 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


1 

1  1 


1  2 


1 
4 
2 
3 

4 

14 


Percent  of  class- 
rooms 


6% 


6%    28%    61%      5%  11% 


5% 


5%  74% 


Table  69 

GUESSING  GAMES,  TABLE  GAMES,  PUZZLES  (Variable  65)— HIGH/SCOPE 


Sites 


First  Grade  Classrooms 
wi  th  Implementation 

 Scores  of  

l'^      2*      3        4  5 


Greenwood,  Miss. 
Ft.  Walton  Beach,  Fla. 
NYC  P.S.  92M 
Greeley ,  Colo. 
Denver,  Colo. 

Total  classrooms 


1_ 
2 


3 
2 
2 

3 
1 

11 


Third  Grade  Classrooms 
with  Implementation 

 Scores  of  

^P^      2        3        4  5 


Percent  of  class- 
rooms 


11%    28%  61% 


16% 


42%  42% 


Some  40%  of  the  first  grade  (the  two  lowest  quintiles)  and  20%  of  the 
third  grade  (lowest  quintile)  Non-Follow  Through  classrooms  had  a  mean 
of  zero.     No""  High/Scope  site  had  a  mean  of  zero. 
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Table  70 

SEWING,  COOKING,  POUNDING  (Variable  70) —HIGH/ SCOPE 


Sites 


First  Grade  Classrooms 
with  Implementation 
Scores  of 
2*      3^^      4  T 


Greenwood,  Miss. 
Ft.  Walton  Beach,  Fla. 
NYC  P:S.  92M 
Greeley,  Colo. 
Denver,  Colo. 

Total  classrooms 

Percent  of  class- 
rooms 


4 
3 
1 
2 

10 


1 
2 
1 
4 


Third  Grade  Classrooms 
with  Implementation 
Scores  of  


2^ 


10 


56%  44% 


53%  47% 


Approximately  60%  of  the  Non-Follow  Through  classrooms  in  both  first 
and  third  grade  (the  three  lowest  quintiles)  had  a  mean  of  zero.  Only 
the  first  and  third  grade  classrooms  at  Greenwood  had  a  mean  of  zero 
on  this  variable  (see  Appendix  0) . 


Table  71 

NUMBERS,  MATH,  ARITHMETIC  (Variable  66)"HIGH/SCOPE 


Sites 


Greenwood,  Miss. 
Ft.  Walton  Beach,  Fla. 
NYC  P.S.  92M 
Greeley ,  Colo . 
Denver,  Colo. 

Total  classrooms 

Percent  of  class- 
rooms 


irst  Grade  Classrooms 
with  Implementation 
Scores  of 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


1 
1 


1^2 
5  11 


1  3 


17%    28%    11%    17%    28%    58%    16%      5%      5%  16% 
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the  fact  that  children  were  engaged  in  working  out  mathematical  relation- 
ships and  problems  while  cooking,  sewing,  or  constructing.    This  may  ex- 
plain in  part  the  low  implementation  scores  on  this  variable. 

Teachers  and  aides  are  most  likely  to  interact  with  small 
groups  of  children  as  the  children  plan  the  day's  activities  or  as  they 
report  their  evaluation  of  the  day's  work.     Except  for  one  first  grade 
classroom,  the  37  High/Scope  classrooms  are  in  the  fourth  or  fifth 
quintile  on  these  variables  related  to  teachers  and  aides  working  with 
small  groups  (see  Tables  72  and  73). 

Although  High/Scope  children  often  work  in  small  groups, 
it  is  important  that  the  adults  interact  with  one  child  at  a  time. 
Table  74  presents  data  regarding  the  focus  of  the  adult  communication. 
Note  that  77%  of  the  first  grades  and  85%  of  the  third  grades  are  in  the 
fourth  or  fifth  quintile  on  this  variable.     Only  three  Greenwood  first 
grades  and  one  Fort  Walton  Beach  first  grade  are  in  the  lower  quintiles 
on  this  variable. 

Adults  try  to  encourage  children  to  think  about  problem 
solving  and  planning.     One  way  to  do  this  is  to  isk  open-ended  questions. 
Findings  presented  in  Table  75  indicate  that  there  is  a  wide  range  in 
implementcitiop  within  site  and  among  sites  on  this  variable. 

Similarly,  children  are  encouraged  to  ask  questions.  As 
shown  j.n  Table  76,  only  Greeley  has  all  of  their  classrooms  attaining 
implemenuation  scores  of  5.     Other  sites  have  scattered  classroom  scores 
on  this  variable. 

e.       Summary  of  Implementation 

Other  implementation  findings  for  High/Scop3  are  presented 
in  Appendix  M,  Table  M-7.     For  the  most  part,  High/Scope  classrooms  are 
well  implemented.     Excepting  the  New  York  third  grades,  they  differ  from 
the  traditional  classrooms  and  their  total  implementation  scores  place 
them  on  the  upper  end  of  the  comparison  measuring  stick.     There  is  little 
deviation  in  implementation  scores  of  classrooms  within  a  site.  The 
gieatest  difference  among  site  total  implementation  scores  is  found  be- 
tween New  York  (65)  and  Greeley  (82)  third  grades.     Even  with  a  high  per- 
cent of  children  who  speak  English  as  a  second  language,  Greeley  has  been 
very  successful  in  implementing  the  model. 

Using  the  criteria  stated  for  this  evaluation  we  conclude 
that  High/Scope  would  most  likely  be  able  to  implement  their  model  in 
other  sites  similar  to  the  ones  used  in  this  analysis. 

A  study  of  observer  accuracy  for  High/Scope  indicates  that 
the  codes  which  form  the  variables  used  in  this  section  were  acceptably 
reliable  (s2e  Appendix  L,  Table  L-6). 
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Table  72 


TEACHER  WITH  SMALL  GROUP  (Variable  88)~HIGH/SC0PE 


Sites  12  3 


Greenwood,  Miss. 
Ft.  Walton  Beach,  Fla. 
NTC  P.S.  92M 
Greeley,  Colo. 
Denver,  Colo. 

Total  classrooms 

Percent  of  class- 
rooms 


First  Grade  Classrooms 
with  Implementat ion 

Scores  of  

4  5 


4 

112 
1  2 
3 

_    _4 

1        2  15 


6T    11%  83% 


Third  Grade  Classrooms 
with  Implementation 

 Scores  of  

1        2        3        4  ^ 

4 

1  3 
4 
3 

1  ^ 

2  17 


117  89% 
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Table  7  3 


AIDE  WITH  SMALL  GROUP  (Variable  94)~HIGH/SCOPE 


First  Grade  Classrooms      Third  Grade  Classrooms 
with  Implementation  with  Implementation 


Sites 

Scores 

of 

Scores 

of 

1''      2  3 

4 

5  1* 

2*  3 

4 

5 

Greenwood,  Miss. 

4 

4 

Ft.  Walton  Beach,  Fla. 

4 

2 

2 

NYC  P.S.  92M 

1 

2 

4 

Greeley,  Colo. 

1 

2 

1 

2 

Denver,  Colo. 

A 

4 

Total  classrooms 

6 

12 

3 

16 

Percent  of  class- 

rooms 

33% 

67% 

16% 

84% 

In  Non-Follow  Through, 

some  40%  of 

the  third  grade 

classrooms 

(the 

two 

lowest  quint iles)  and  20%  of  the  first  grade  classrooms  (the  lowest 
quintile)  had  a  mean  of  zero.     No  High/Scope  site  had  a  mean  of  zero. 


Table  74 

ADULT  COMMUNICATION  OR  ATTENTION  FOCUS,  ONE  CHILD 
(Variable  438a)— HIGH/SCOPE 


First  Grade  Classrooms      Third  Grade  Classrooms 

with  Implementation  with  Implementation 
 Scores  of    Scores  of  


Sites 

1 

2  3 

4 

5 

1  2 

3 

4 

5 

Greenwood,  Miss. 

3 

1 

1 

3 

Ft.  Walton  Beach,  Fla. 

1 

1 

1 

3 

NYC  P.S.  92M 

2 

1 

4 

Greeley,  Crlo. 

3 

3 

Denver,  Colo, 

2 

2 

1 

1 

1 

1 

Total  classrooms 

3 

1 

6 

8 

1 

2 

6 

10 

Percent  of  class- 

rooms 

17% 

6% 

33% 

44% 

5% 

11% 

32% 

53% 
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Table  75 


ADULl  OPEN-ENDED  QUESTIONS  TO  CHILDREN  (Variable  452a)— HIGH/SCOPE 


First  Grade  Classrooms  Third  Grade  Classrooms 

with  Implementation  with  Implementation 

 Scores  of    Scores  of  

Sites                   1234       5  12345 


Greenwood,  Miss.              12                        111  11 

Ft.  Ualton  Beach,  Fla.             1111  1  3 

NYC  P.S.  92M                                     1112  11 

Greeley,  Colo.                  2                1  2  1 

Denver,  Colo.                                     1                  3                  1  12 

Total  classrooms  3342614338 

Percent  of  class- 
rooms 17%    17%    22%    11%    33%      5%    21%  16%    16%  42% 


Table  76 

CHILD  QUESTIONS  TO  ADULT  (Variable  350a)~HIGH/SC01r'E 


Fiist  Grade  Classrooms      Third  Grade  Classrooms 
with  Implementation  with  Implementation 

 Scores  of    Scores  of  

Sites  1234512345 


Greenwood,  Miss.  112  11  11 

Ft.  Walton  Beach,  Fla.  13  4 

NYC  P.S.  92M  3  1111 

Greeley,  Colo.  3  3 

Denver,  Colo.    _1  1_    _1_    i 

Total  classrooms  1335623266 

Percent  of  class- 
rooms 6%    17%    17%    28%  33%    11%    16%    11%    32%  32% 
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7.      EDC  Open  Education  Program 


a.  Description  of  the  Model 

The  EDC  Follow  Through  approach  is  a  program  designed  to 
help  communities  generate  their  own  resources  to  implement  open  educa- 
tion.    EDC  believes  that  learning  is  facilitated  by  a  child^s  active 
participation  in  the  learning  process,  that  learning  is  optimized  in  a 
setting  that  provides  a  range  of  materials  and  problems  to  investigate. 
The  program  is  based  on  t  e  beliaf  that  children  learn  in  many  differ- 
ent ways  and  therefore  they  should  te  provided  a  variety  of  opportunities 
and  experiences.     Traditional  academic  skills  are  important,  but  they  are 
more  usefully  and  permanently  learned  when  children  have  many  opportune- 
ities  to  develop  them  in  flexible,  self-directed  ways  that  allow  learn-- 
ing  to  become  a  part  of  their  life  style  outside  as  well  as  in  the  class- 
room. 

Interweaving  of  subject  matter  is  essential  to  the  open 
classroom.     Children  are  expected  to  be  purposefully  mobile  and  inde- 
pendent, choosing  activities  out  of  their  own  interests.    Thus,  class- 
rooms are  often  divided  into  several  interest  areas  for  activities  " 
in  construction,  science,  social  studies,  reading,  math,  art,  and  music. 
Any  or  all  of  these  interest  areas  may  be  used  simultaneously  by  chil- 
dren during  the  day.     An  interdisciplinary  or  curriculum  core  approach 
is  often  used  to  teach  reading,  writing,  and  computation  through  a 
project,  such  as  settirg  up  and  operating  a  store.     Essentially,  the 
intent  of  this  approach  is  to  encourage  the  development  of:     (1)  problem- 
solving  skills;   (2)  the  ability  to  express  oneself  both  creatively  and 
functionally;   (3)  the  ability  to  respect  one^s  own  thoughts  and  feelings; 
and  (4)  the  ability  to  take  responsibility  for  one's  own  learning. 

b.  Description  of  the  Sites 

The  five  EDC  sites  at  which  observations  were  conducted 
are  Burlington,  Vermont;  Philadelphia,  Pennsylvania;  Paterson,  New 
Jersey;  Rosebud,  Texas;  and  Smithfield,  North  Carolina.    They  range  in 
population  classification  from  rural  to  big  city. 

As  can  be  seen  in  Table  77,  Rosebud  differs  from  the 
other  Slates  in  that  the  $4,522  median  family  income  is  the  lowe<5t  in 
the  sample  and  its  percent  of  families  below  poverty  level*  is  the  high- 
est.    Sr.xthfield,  similar  to  Rosebud,  has  a  low  median  family  income 
and  a  high  percent  of  families  below  poverty  level.    Rosebud  and  Fater- 
son  both  show  much  lower  percentages  of  adults  over  25  who  have  completed 
high  school  than  the  average  for  Follow  Through. 


*The  U.S.  Census  Bureau  uses  U.S.  Office  of  Economic  Opportunity 
poverty  index  guidelines  to  establish  poverty  level. 
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T'-^ble  77 


SITE  AND  DEMOGRAPHIC  DATA  FOR  EDC  SITES 


A.    Geographic  Data 


Site 
Code 

1101 
1x03 
1106 
1107 


Site  Location 

Burlington,^  Vermont 
Philadelphia  IV,  Pa. 
Paterson,  N.J. 
Rosebu  . ,  Texas 


Region 


Metropolitan      Popu3  ation 


1108    Smithfield,  N.C. 


North  East 
Middle  Atlantic 
Middle  Atlantic 
West  South  Cen- 
tral 
South  Atlantic 


Status 


Small  city 
Big  city 
Medium  city 
Rural 


Town 


(1970  census) 

38,633 
1,948,609 
144,824 
1,597 

6,677 


B.    Demographic  Data  for  Total  Population 

Percent  of 


Site  Name 

Median 
Family 
Income 

Percent  of 
Families  Below 
Poverty  Level 

Percent  of 
Population 
Nonwhite 

Adults  Over  25 
I'/ho  Finished 
High  School 

Burlington 

$9,908 

7.7% 

0.7% 

61.8% 

Philadelphia  IV 

9,366 

11.2 

34.4 

39.9 

Paterson 

8,716 

12.4 

28.3 

31.3 

Rosebud 

4,522 

34.3 

20.9 

27.1 

Smithfield 

6,368 

26.9 

37.6 

43.4 

Average  for 

all  sites 

$8,631 

13.9% 

20.7% 

49.7% 

Characteristics  of  the  Follow  Through  Evaluation  Sample 
at  the  Site  for  First  Grade** 


Site  Name 


Burlington 
Philadelphia  IV 
Paterson 
Rosebud 
Smithfield 


Average  Percent 
with  Preschool 

58% 

53 

86 

55 

56 


-iverage  Percent  with  Average 

First  Language  Baseline 

Other  than  English  Score 

0%  25 

1  3l 

8  23 
2 
0 


Not  within  Standard  Metropolitan  Statistical  Area  (SMSA) . 

Taken  from  the  Follow  Through  Roster;  represents  the  Follow  Through 
evaluation  sample. 

Sources:    U.S.  Bureau  of  the  Census,  1970;  SRI 
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In  contrast  to  the  other  EDC  sites,  in  Burlington  the 
percent  is  lowe>*  for  families  below  poverty  level  as  it  is  for  the  per- 
cent of  nonwhites.    Also  the  average  percentage  of  adults  over  25  who 
have  completed  high  school  is  considerably  higher  than  in  the  other  EDC 
sites. 


c.      Sponsor  Implementation  Variables 

Tables  of  the  critical  variables  selected  by  the  authors 
to  assess  implementation  of  the  EDC  model  can  be  found  in  Appendix  M. 
The  tables  in  Appendix  M  describe  che  implementation  score  for  each 
variable  for  each  classroom.     It  must  be  noted  that  EDC  does  not  expect 
classrooms  to  conform  to  ntodel  specifications  or  differ  radically  from 
traditional  classrooms.     EDC  is  an  "approach"  to  education  that  recog- 
nizes, respects,  and  incorporates  differences  into  its  program.  Ideas 
are  offered  about  how  to  arrange  classroom  environments  and  hov  to  pre- 
pare low-cost  exploratory  materials  for  children.    But  by  their  own 
example  of  not  intruding  or  insisting  upon  conformity,  they  intend  to 
encourage  their  teachers  to  respect  the  rights  and  opinions  of  children, 
to  treat  them  as  individuals,  and  to  encourage  cooperation  rather  than 
competition  among  members  of  the  groups.    The  extent  to  which  this  occurs 
is  not  assessed  in  this  evaluation.    Workshops  and  guidance  are  offered 
by  EDC  and  teacher  attendance  is  voluntary  rather  than  mandatory. 

The  sponsor  did  not  select  any  variables  as  critical  to 
the  implementation  of  the  model.    They  did  not  wifh  to  place  constraints 
jpon  the  model.     In  lieu  of  a  sponsor  selection  and  in  order  to  carry 
out  the  specified  analysis  the  authors  selected  the  variables  presented 
in  the  report  on  the  basis  of  discussion  with  sponsor  representatives, 
experience  in  the  classrooms,  and  reading  available  literature.    A  few 
of  the  variables  selected  as  critical  are  presented  in  the  text. 

The  variables  selected  for  the  EDC  model  are  of  course 
limited  descriptors  of  the  program.    As  previously  stated,  many  pro- 
cesses and  procedures  important  to  the  program  are  not  assessed  in  this 
study  of  implementation.     For  example,  adults  are  encouraged  to  provide 
a  setting  with  a  range  of  materials  where  children  can  investigate  prob- 
lems.    Teachers  are  also  encouraged  to  interweave  subject  matter.  Our 
observation  can  only  record  the  fact  that  a  variety  of  materials  are 
available  and  are  used,  that  a  wide  variety  of  activities  occur  concur- 
rently, and  that  children  engage  in  activities  independently.     However,  a 
great  as  the  semantic  gap  is  between  the  variable  and  the  goal,  EDC  class 
rooms  have  been  distinguished  from  Non-Follow  Through  and  other  educa- 
tional models  in  past  analysis. 

How  the  implementation  scores  were  computed  is  described 
in  the  methodology  section  on  page  100.     Since  the  aim  of  sponsors  was  to 
differ  in  specific  ways  from  traditional  classrooms,  the  traditional 
classroom  has  been  used  as  the  standard  yardstick  to  measure  each  spon- 
sor's implementation.    Twenty  variables  were  selected  for  first  grade 


182 


and  Tl  tor  second  grade  for  EDC  as  those  on  which  one  could  expect  their 
classrooms  to  be  different  from  conventional  classrooms.    An  implementa-- 
tion  score  of  3  would  indicate  the  classroom  was  in  the  mid-range  rela- 
tive to  conventional  classrooms;  an  irrplementation  score  of  5  would  mean 
that  the  model  classrooms  were  in  the  uppermost  range  of  conventional 
classrooms. 


d.       Implementation  Findings 

Figure  31  and  Table  78  present  the  total  implementation 
scores  for  each  classroom  by  grade  level.     These  total  scores  were  com- 
puted by  adding  each  quintile  score  of  EDC's  35  implementation  variables 
and  dividing  by  the  total  maximum  score.     Thus,  an  average  score  on  all 
variables  was  computed.    The  scores  are  presented  as  percentages. 
Total  scores  for  Non-Follow  Through  classrooms  were  also  computed  for 
the  EDC  implementation  variables.    Means  and  standard  deviations  are 
presented  in  Table  78  along  with  the  results  of  one-tailed  t-tests, 
comparing  Non-Follow  Through  with  EDC.     Table  78  presents  the  analysis 
of  variance  among  sites. 

The  t-test  pre5;ented  on  Table  78  indicates  that  the  EDC 
classroom  means  are  different  statistically  from  the  Non-Follow  Through 
classrooms  in  both  the  first  and  third  grades.     Histograms  in  Figure  31 
show  that  while  the  range  for  EDC  and  Non-Follow  Through  first  grades 
is  similar,  :.he  mean  for  EDC  is  16  points  higher.     In  the  third  grade 
the  overlap  of  EDC  classrooms  scores  with  Non-Follow  Through  is  not  so 
great.     Only  one  EDC  third  grade  hc?s  a  score  lower  than  the  Non-Follow 
Through  mean  score. 

The  analysis  of  variance  i:hows  that  the  variability  among 
sites  ib  statistically  greater  relative  to  the  within  site  variance  in  both 
first  and  third  grades.     Philadelphia's  low  score  seems  to  account  for  most 
of  this  variance  for  both  first  and  third  grades.     Not  only  are  their 
implementation  scores  lower  than  other  sites,  their  within-site  variation 
is  greater.     There  are  no  obvious  differences  in  the  demographic  nature 
or  tl     child  characteristics  between  Philaflelphia  and  the  other  EDC  sites 
(see  Tables  3,  4,  and  77).    The  difference  in  implementation  scores  might 
be  explained  by  two  prolon^^o.d  teacher  sirjkos  in  Philadelphia.     It  is 
possible  that  when  tension  is  high  teachers  may  become  more  structured 
and  adhere  less  to  the  theory  of  the  model.     Part  of  this  variance  might 
also  be  attrioutable  to  the  first  grade  observer.     She  had  difficulty  in 
recording  Code  4  reliably  (Instruction,  explanation)  on  the  videotapes 
(see  Appendix  L,  Table  L-7).     It  must  be  noted  that  all  other  sites  have 
high  implementation  scores  and  low  vithin  site  variance. 

For  this  analysis,  most  classrooms  are  expected  to  be 
at  the  upper  range  of  the  scale  when  compared  to  traditional  class- 
rooms;    however,  since  EDC  is  an  approach  and  not  a  model,  the  analysis 
for  this  program  will  be  descriptive  of  what  occurs  in  their  classrooms 
as  compared  with  traditional  classrooms. 
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FIGURE  31      HISTOGRAM  SHOWING  IMPLEMENTATION  SCORES  FOR  EDC 


18^ 


ERLC 


Table  78 


TOTAL  IMPLEMENTATION  SCORES  FOR  CLASSROOMS  BY  SITE— EDC 

First  Grade   


Classroom  Scores   Site  Scores 


Sites 

1 

2 

3 

4 

X 

S.D. 

Burlington  (EK) 

91. 

0% 

91.0% 

86.0% 

93.0% 

90.2% 

3.0 

Philadelphia  IV  (EK) 

72. 

0 

80.0 

58.0 

48.0 

64.5 

14.3 

Paterson  (EK) 

70. 

0 

79.0 

79.0 

73.0 

75.2 

4.5 

Rosebud  (EK) 

72. 

0 

68.0 

71.0 

70.3 

2.] 

Smithfield  (El) 

85. 

0 

76.0 

86.0 

83.0 

82.5 

4.5 

Sponsor  Scores  (N= 

19)  : 

76.97. 

11.5 

MFT  Scores   (N=35) : 

61.2 

9.6 

t  =  5.35 
p  >  .001 
f  =  7.26 
p  >  .01 


 Third  Grade  

 Classroom  Scores   Site  Scores 

Sites   1  2  3  4  X  S.D. 


Burlington  (EK) 

85. 

5% 

81 

8% 

79 

1% 

75 

5% 

80 

5% 

^'.2 

Philadelphia  IV  (EK) 

75. 

5 

64 

5 

73. 

6 

59 

1 

68 

2 

7.7 

Paterson  (EK) 

67. 

3 

69 

1 

77 

3 

73 

6 

71 

.8 

4.5 

Rosebud  (EK) 

85 

5 

80 

0 

79 

1 

81 

.5 

3.4 

Smithfield  (El) 

76 

4 

79 

.1 

77 

.7 

1.9 

Sponsor  Scores  (N= 

17): 

.75 

.4% 

7.1 

NFT  Scores   (N=36) : 

60 

.7 

10.6 

t  =  5.18 
p  >  .001 
f  =  4.54 
p  >  .05 
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Scores  for  each  critical  implementation  variable  for  each 
EDC  site  and  classroom  are  presented  in  Appendix  M,  Table  M-8  in  tabular 
form.    The  tables  are  prepared  so  that  the  number  of  teachers  receiving 
a  particular  implementation  score  is  entered  in  a  column.    The  teachers 
from  each  site  are  entered  in  the  rows.     The  total  number  of  teachers 
receiving  a  particular  implementation  score,  as  well  as  the  percentage 
computed,  is  entered  on  the  bottom  rows.     Only  a  few  critical  variables 
will  be  discussed  in  this  text.     For  example,  as  shown  in  Table  79, 
in  63%  of  the  first  grade  EDC  classrooms  and  in  71%  of  the  third  grade 
classrooms,  the  children  receive  individual  iiistruction  more  often. 
Therefore,  they  are  at  the  upper  end  of  the  scale  when  compareu  to 
Non-Follow  Through  classrooms. 

Findings  in  Table  80  emphasize  the  fact  that  the  focus 
of  adult  communication  is  toward  one  child  at  a  time.    Thus,  84%  of  the 
first  grades  and  71%  of  the  third  grades  have  implementation  scorer*  of 
4  or  5  in  this  variable. 

Communication  between  teachers  and  students  in  EDC  class- 
rooms is  usually  more  informal  than  in  traditional  classrooms.  Ac; 
shown  in  Table  81,  task-related  conversations  take  place  between  teacher 
and  students.     All  of  the  Philadelphia  classrooms  havia  the  highest  im- 
plementation score  (5)  on  this  variable. 

EDC  children  are  encouraged  to  inquire  and  ask  questions 
(Table  82).     While  the  frequency  of  asking  questions  is  low,  it  is 
important  to  note  that  children  in  Burlington  in  both  first  and  third 
grades  had  implementation  scores  of  4  or  5.     Philadelphia  and  Smithfield 
first  grades  also  received  these  implementation  scores.     Paterson  and 
Rosebud  had  a  mean  of  zero  in  both  first  and  third  grades;  therefore 
their  implementation  score  of  4  is  misleading.     (See  Appendix  0) 

^        To  encourage  questioning,  adults  respond  to  questions  with 
more  questions.     As  indicated  in  Table  83,  EDC  adults  are  at  the  upper 
end  of  the  scale  for  this  variable. 

The  children  engage  in  self  instruction.    As-shovm,  in 
Table  84,  the  third  grade  implementation  scores  are  higher  for  this 
variable  than  are  the  first  grade  scores.     This  may  reflect  a  develop- 
mental aspect  of  children  in  this  program — they  may  be  more  capable  or 
more  desirous  of  working  alone  when  they  are  older. 

A  limited  assessment  of  children's  pleasure  is  made  by 
means  of  a  variable  based  on  records  of  smiles  and  laughter.  These 
findings  are  p^;esented  in  Table  85.    Although  the  classrooms  scatter 
across  all  of  t\^  scores,  53%  of  the  EDC  first  grades  and  48%  of  the  EDC 
third  grades  are  ht  the  upper  end  of  the  scale  for  Var.  460a  (All  child 
positive  affect).  \^ 

Adults  also  express  positive  behavior  toward  children  by 
smiles  or  laughter.  Table  86  indicates  that  over  50%  of  the  EDC  class- 
rooms have  implementation  scores  of  4  or  5  on  this  variable. 
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Table  79 


ADULT  INSTRUCTS  AN  IXDIVIDUAI-  CHILI)  (Variable  375a)— CDC 


S  1  tes 


Burl  mgton,  Vernont 
Philadelphia  IV,  Pa. 
Paterson,  N.J . 
Rosebud,  Texas 
Srilhf ield,  N.C. 

Total  classrooms 


rirst  (irade  (Massroors 
w  i  t  h  I  v\  p  1  'nc'  n  Ui  c  L  o  n 

Scores  i M  

12        3        4  5 


I 


Third  (irade  Classrooi^ 
K'Lcii  Implement  at  ior 

 Scores  of 

1        2        3  A 


1 


L nr  c r  V  1  ass ■ 
roor;s 


li;      11       16       26       37       1  2 


12, 


Table  HQ 

ADULT  COMMLNICATiON  OR  ATlKN'ilON  FOCIS,  ONL  CHILD  (Variable  A38a)--EDC 


Sites 


First  C'rade  Classroor^s 
wX t^h- p p  1  ene n  c  a  t  i  o n 

Scores  t>!   

2         ]        ^  3 


Third  Grade  Classr(nv>\s 
with  liTiplementat  ion 

 S cores  oi  

'^2^      3  ' "  "3 


ijur  1  in>;  ton  ,  \erir.ont 
Pi)i  lad.'lDiua  TV,  Pa. 
:\i  ters.Tn", "  -N.  I . 
Kosebud ,  lexas 
Sruthfield,  X.C. 

Total  c  lassro(^r.s 


•4 

0 


Percent  oT  chiss- 
roors 


16; 


37'^    /^-/    ijo^  18'/ 


47^ 
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Table  81 


ADULT  TASK-RELATED  COMMENTS  TO  CHILDREN  (Variable  390a)~EDC 


First  Grade  Classrooms      Third  Grade  Classrooms 
with  Implementation  with  Implementation 

Scores  of  Scores  of 


Sites 


Burlington ,  Vermont                                  13                                  2  2 
Philadelphia  IV,  Pa.                                        4  4 
Paterson,  N.J.                         12        1                3  1 
Rosebud ,  Texas                                 3  12 
Smithfield,  N.C.      _2_    _2_        _2_ 

Total  classrooms  154931148 

Percent  of  class- 
rooms 5%    26%    21%    47%    18%      6%      6%    24%  47% 


Table  82 

ALL  CHILD  OPEN-ENDED  QUESTIONS  (Variable  450a) ~EDC 


Sites 


Burlington,  Vermont 
Philadelphia  IV,  Pa. 
Paterson,  N. J . 
Rosebud ,  Texas 
Smithfield,  N.C. 

Total  classrooms 

Percent  of  class- 
rooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


12 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


4 
4 
3 
2 

13 


63%  37% 


76%  24% 


5Sc 

60%  of  the  Non-Follow  Through  classes  had  mean  =  zero. 
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Table  83 

ADULT  RESPONSE  TO  CHILD^S  ^..ESTION  WITH  A  QUESTION  (Variable  453a)— EDC 


Sites 


Bui lington ,  Vermont 
Philadelphia  IV,  Pa. 
Paterson,  N.J. 
Rosebud,  Texas 
Sinithfield,  N.C. 

Total  classrooms 


First  Grade  Classrooms 
with  Implementation 

Scores  of  

jF     2        3  '    4  5 


Third  Grade  Classrooms 

with  Implementation 
   Scores  of  


Percent  of  class- 
rooms 


?17    32%    21%  26? 


18%    18%    47;'  18% 


Some  of  the  Non-Follow  Through  classes  (the  lowest  quintile)  had  a  mean 
of  zero.     No  EDC  site  had  a  mean  of  zero. 

Table  84 

CHILD  SELF- INSTRUCTION,  OBJECTS  ^Variable  510c)— EDC 


Sites 


Bur 1 ington ,  Vermont 
Philadelphia  IV,  Pa. 
Paterson,  N.J. 
Rosebud,  Texas 
Snithfield,  N.C. 

Total  classrooms 


First  Grade  Classrootns 
with  Implementat ion 

 Scores  of  

2        3       4  5 


1 
4 
1 
1 

9 


1 

1  2 
1  3 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


9« 


Percent  of  class- 
rooms 


47% 


5%    16%  32% 


35%    29%  35% 


Some  20%  of  the  Non-FoUow  Through  first  grade  classes   (lowest  quin- 
tile) had  a  mean  of  zero,  and  40%  of  the  third  grade  (two  lowest  quin- 
liles)  had  a  mean  of  zero.     Only  the  Philadelphia  IV  first  grade  had 
a  mean  of  zero  on  Variable  510c. 
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Table  85 


ALL  CHILD  POSITIVE  AFFECT  (Variable  460a)— EDC 


SiCes 


Bu r 1 ing  t on ,  Ve  rmon  t 
Philadelphia  IV,  Pa. 
Paterson,  N.J. 
Rosebud,  Texas 
Smithfield,  N.C. 

Total  classrooms 

Percent  of  class- 
rooms 


First  Grade  Clas.^rooms 
with  Implementation 
Scores  of 


Third  Grade  Classrooms 
wi  th  Imp lemen t a  t  ion 
Scores  of 


16%      5%    26%    37%    16%      6%    12%    35%    24%  24% 


Table  86 

POSITIVE  BEHAVIOR,  ADULTS  TO  CHILDREN  (Variable  423a)— EDC 


Sites 


Burlington,  Vermont 
Philadelphia  IV,  Pa. 
Paterson,  N.J. 
Rosebud ,  Texas 
Smithfield,  N.C. 

Total  classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


Percent  of  class- 
rooms 11%    16%    11%    26%  37% 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


1 
1 
3 


29%    18%      6%  47% 
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Summary  of  Implementation 


Other  implementation  findings  for  EDC  arc  presented  in 
Appendix  M,  Table  M-8.    l/hat  occurs  in  KDC  classrooms  has  been  described 
in  part  by  these  data,  in  comparison  with  Non-Follow  Through  classrooms. 
Much  of  what  EDC  believes  in,  such  as  an  individualized  approach  to  chil- 
dren, encouraging  cooperation  and  inquiry  on  the  part  of  children,  and  ex- 
hibiting positive  regard  on  the  part  of  all  participants,  seems  to  bo 
reflected  in  the  findings. 

Excepting  two  Philadelphia  first  grades,  the  EDC  class- 
rooms differ  from  the  Non-Follow  Through  classrooms  mean  score.  Also 
with  the  exception  of  Philadelphia  (which  had  two  serious  teacher  strikes 
during  the  school  year)  there  is  very  slight  within-site  or  among-site 
variance.    These  signs  of  implementation  as  judged  by  the  criteria  of 
this  evaluation  are  fairly  remarkable  given  that  EDC  does  not  make  a 
great  effort  to  have  teachers  conform  to  a  set  of  specifications.  Ap- 
parently part  of  the  theory  that  they  are  trying  to  communicate  is  being 
communicated ♦ 

A  check  of  observer  reliability  indicates  that  observers 
in  Philadelphia  first  grades  and  Rosebud  first  and  third  grades  had  dif- 
ficulty with  Code  4  (instruction,  explanation),  on  the  videotaped  simu- 
lations (see  Appendix  L,  Table  L-7) .     Nevertheless,  data  from  Rosebud 
obst^rvers  are  consistent  with  those  of  other  sites  (see  Table  78).  How- 
ever, data  from  Philadelphia  first  grade  classrooms  do  differ  from  other 
EDC  first  grades. 


A  Study  of  the  Relationship  Between  Teacher  Characteristics/ 
Training  and  Implementation  Scores 

In  the  study  of  implementation  i t  is  important  to  try  to  understand 
what  methods  or  stratpgies  sponsors  employed  to  bring  about  the  changes 
in  teacher  behavior  and  what  teacher  characteristics  are  related  to 
classroom  implementation.     The  evaluation  of  teacher  conformity  to 
sponsor  goal,  which  was  described  for  each  sponsor  in  the  preceding 
section,  leaves  no  doubt  that  implementation  of  the  Follow  Through 
models  has  taken  place  in  different  degrees  in  many  diverse  sites. 

In  an  effort  to  understand  elements  in  the  sponsors'  in-service 
teacher  training  program  which  were  effective  in  the  implementation 
process  and  teacher  characteristics,  items  from  the  Teacher  Question- 
naire regarding  training,  teacher  experience,  education  and  satisfac- 
tion with  the  sponsor's  model  were  selected  for  analysis.  Unfortunately 
tiic  items  on  the  questionnaires  were  inadequate  to  yield  the  information 
necessary  to  understand  the  sponsors*  teacher  training  stra»:egies.  Partial 
correlations  were  computed  between  implementation  scores  and  items  from  the 
teacher  questionnaire.     No  significant  correlations  were  found   (see  Appen- 
dix T.     Information  regarding  the  in-service  training  procedures  of  spon- 
sors can  be  obtained  from  the  individual  sponsors. 
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Classroom  Description 

The  only  analysis  of  items  from  the  Teacher  Questionnaire  to  be 
used   in    this  study  are  those  where  teachers  describe  their  classrooms. 
The  rating  scale  and  the  items  are  presented  in  Figure  32,    A  structure/ 
flexibility  scale  was  developed  to  assess  these  descriptions.  Those 
items  describing  rhe  most  structured  environments  were  given  a  score  of 

I.  Those  items  describing  the  most  flexible  environments  were  given  a 
score  of  5. 

The  lowest  possible  score  (if  all  I's  were  checked)  would  be 

II,  indicating  structure  and  the  highest  possible  score  (if  all  5's  were 
checked)  would  be  55,  indicating  flexibility.    The  results  of  this  anal- 
ysis are  presented  on  Table  87.    The  coefficient  «  for  the  scale  was  equal 
to  .76. 

Far  West  Lab's  five  sites  are  diverse  geographically,  and  yet 
the  reports  from  the  37  responding  Far  West  Lab  teachers  of  their  class- 
rooms are  very  similar  (only  3.1  difference).     In  fact,  their  class- 
reports  are  so  similar  that  we  must  conclude  that  this  sponsor's  train- 
ing has  shaped  the  behaviors  of  these  teachers  (see  Table  87). 

University  of  Arizona's  29  responding  teachers  differed  by  6 
points  on  the  descriptions  of  their  classrooms.    The  reader  is  reminded 
that  in  the  description  of  implementation  for  University  of  Arizona, 
page  123,  the  classrooms  had  a  relatively_ high  variance  in  implementation 
scores.     Theoretically,  on  a  flexibility/structure  scale  they  should 
fall  between  Far  West  and  University  of  Kansas.    However,  given  the 
diversity  of  sites,  the  teachers'  reports  are  remarkably  similar. 

The  uniformity  of  Bank  Street's  sites  (Brattleboro,  Fall  River, 
New  York  City,  and  Tuskegee)  is  notable.    The  teachers'  descriptions  of 
their  own  classrooms  in  rural  Alabama  are  only  2  points  different  from 
that  of  the  teachers  in  New  York  City.    The  Bank  Street  sponsor's  in- 
formal report  to  SRI  of  implementation  in  Philadelphia  has  been  quite 
different  from  its  reports  of  the  other  sites,  and  the  8.7  difference 
reflects  such  anomalies. 

The  educational  theories  of  the  sponsors  previously  described 
(Far  West  Lab,  University  of  Arizona,  and  Bank  Street)  would  place 
them  higher  on  the  scale  of  flexibility  tl.an  the  University  of  Oregon 
and  University  of  Kansas  models  which,  in  terms  of  their  theories,  should 
be  lower  on  this  scale,  or  more  structured.    Table  87  indicates  that  not 
only  are  reports  from  the  32  responding  University  of  Oregon  teachers 
very  similar  to  each  other  but  that  these  teachers  also  feel  that  the 
program  is  the  most  structured  of  all.    University  of  Kansas  teachers 
report  a  level  of  structure  below,  and  not  overlapping  with  that  of 
University  of  Oregon  sites.     Theoretically,  University  of  Kansas  is  not 
as  structured  as  University  of  Oregon  since  "spend  time"  is  allowed 
(allowing  child  options),  as  well  as  a  structured  "work  time." 
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Table  87 

FOLLOW  THROCGH  TFACHER  RATINGS  ON  THE  CLASSROOMS'  STRUCTURE/FLEXIBILITY  SCALE* 


Sponsors  and  Sites  

Far  Wesc  Laboratory  for  Educational 
Research  and  Development  

0201  Berkeley,  Calif. 

0204  Puluth,  Minn. 

0207  Lebanon,  N.H. 

0209  Salt  Lake  City,  Utah 

0213  Tacoma,  Wash. 

University  of  Arizona 

0305  Des  Moines,  Iowa 

0309  Lakewood,  N'.J. 

0311  Newark,  N.J. 

03 16  Lincoln ,  Nebraska 

Bank  Street  College 

0502  Brattleboro,  Vermont 

0504  Fall  Fiver,  Mass. 

0506  New  York  City,  P.S.  243K 

0508  Philadelphia  XI,  Pa. 

0510  Tuskegee,  Ala. 

University  of  Oregon 

0703  E.  St.  Louis,  111  . 

0707  New  York  City,  P.S.  137K 

0708  Racine,  Wise. 
0711  Tupelo,  Miss. 
0719  Providence,  R.I. 

Univerrity  of  Kansas 

0801    New  i-^rk  City,  P.S.  77X 

0803  ^Philadelphia  VI,  Pa. 

0804  Fortageville,  Mo. 

0806  Kansas  City,  Mo. 

0807  Louisville,  Ky. 

High/Scope  Educational  Research 
Founds t Ion  

0901  Greenwood,  Miss. 

0902  Ft.  Walton  Beach,  Fla. 
'903    New  York  City,  P.S.  92M 

0906    Greeiev,  Colo. 
0^07    Denver,  Colo. 

Ed uc  a  1 1  on  De v e  1  op.ne n  t  Center 

1101  Burlington,  Vermont 

ilO^  Philadelphia  IV,  Pa. 

1106  Paterson,  N.J. 

1107  Rosebud,  Texas 

1108  Smlthfield,  N.C. 

Non-Follow  Throuj^h 


Coefficient  y  for  this  scale  was  equal 
:  lability  of  the  scale  will  be  adequate 
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Number  of 
Teachers 
Responding 
to  This  Item  X   S.D. 


37 

41 . 4 

4.9 

7 

40 . 0 

2 . 3 

7 

43.1 

3.7 

8 

40.4 

4.0 

7 

42  .9 

6.0 

8 

40.6 

7  . 1 

29 

39 .8 

4.0 

9 

37 . 1 

4 . 1 

9 

41.1 

4.1 

6 

38.3 

2.3 

7 

43 . 1 

2 . 2 

32 

40.  2 

4.5 

5 

41.6 

4.8 

8 

41.6 

2.7 

8 

41.3 

2.0 

7 

34.6 

5.0 

4 

43.3 

1.3 

31.  .2 

4.4 

7 

30.1 

4.8 

5 

31.6 

5.1 

8 

31 . 0 

4.6 

6 

31.2 

3.4 

6 

32.3 

5.2 

32 

33 . 6 

5.3 

4 

35.5 

5.2 

6 

35.8 

2.5 

7 

32 . 4 

4.0 

8 

32.5 

.7 

7 

33.0 

5.4 

32 

5.7 

10 

39.3 

5.1 

5 

46.2 

5.2 

4 

47.0 

2.9 

5 

44.0 

6.2 

8 

42.5 

6.2 

37 

4^9 

4.8 

8 

43.1 

6.0 

7 

38.6 

5.3 

7 

41.9 

3.8 

9 

44.8 

2.6 

6. 

45.8 

3.3 

60 

35.0 

4.6 

o  .76,  v'hich  indicates  that  the  re- 
for  the  purpose  of  this  study. 


ERIC 


The  teachers  of  High/Scope  and  EDC  vary  somewhat  in  their  de- 
scriptions of  their  classrooms.     The  High/Scope  teachers  in  New  York  City 
report  an  average  of  7.7  points  more  on  the  flexibility  scale  than  do  the 
teachers  in  the  High/Scope  classrooms  in  Greenwood,  Miss,   (see  Table  87). 
EDC's  teachers  in  Smithfield,  N.C.  are  7.2  points  higher  on  the  flexibility 
scale  than  are  the  Philadelphia  teachers.     Nevertheless,  both  models  are 
on  the  upper  end  of  the  flexibility  scale,  which  is  to  be  expected  in 
terms  of  their  educational  theory.     In  the  case  of  EDC  sites,  it  is 
especially  interesting  that  37  responding  teachers  report  a  fair  amount 
of  agreement  as  to  what  occurs  in  their  classrooms.     The  EDC  sponsor 
makes  little  or  no  overt  effort  to  direct  teacher  behavior  toward  specific 
practices.     The  sponsor  acts  primarily  as  a  model  and  presents  alternatives 
to  teachers,  offering  suggestions  on  how  the  room  should  be  organized 
and  which  materials  to  prepare  and  use.    However  the  sponsor's  message 
is  being  delivered  and  received,  since  the  EDC  teachers  describe  their 
c lass rooms  similarly,  regardless  of  site. 

Teachers*  description  of  the  extent  of  structure  in  their  classrooms 
are  quite  distinct,  suggesting  that  the  teachers  teach  differently  as  a 
result  of  their  training  and  experiences  in  the  Follow  Through  program- 

D.  Summary 

No  simple  statement,  such  as  that  all  beven  Follow  Through  sponsors 
have  succeeded  in  implementing  their  model  in  the  sites  which  were  studied, 
can  be  made.  Rather,  conditional  statements  must  be  made.  While  all  spon- 
sor classroom  mean  scores  for  first  and  third  grades  are  significantly  dif- 
ferent from  the  Non-Follow  Through  mean  score,  all  sponsors  except  Far  West 
Lab  and  University  of  Kansas  and  High/Scope  have  some  classrooms  which  have 
scores  below  the  Non-Follow  Through  mean.  In^both  grades  the  University  of ^ 
Kansas  implementation  scores  were  higher  than  those  of  other  sponsors. 

The  least  amount  of  variance  found  among  sites  is  in  the  Far  West  first 
grades  (4.4).     The  most  variance  \vas  found  among  the  EDC  *first  grade  sites 
(11.5).     Bank  Street  and  High/Scope  varied  only  moderately  among  sites  in 
both  grade  levels. 

Implementation  of  the  models  did  not  seem  to  be  affected  by  the  per- 
cent of  children  who  did  not  use  English  as  a  first  language;  e.g.,  the 
scores  in  Salt  Lake  City,  Fall  River,  Greeley,  Denver,  Fort  Worth,  and 
Lakewood  were  comparatively  high. 

Average  low  median  family  incomes  did  not  seem  to  be  related  to  success- 
ful implementation,  e.g.,  Portageville,  Rosebud,  Greenwood,  and  Smithfield. 
All  have  low  average  incomes  and  high  implementation  scores. 

The  size  of  the  city  may  have  had  some  effect.     Large  cities  accounted 
for  seven  of  the  eight  implementation  scores  below  70  (see  Table  88).  The 
implementation  scores  for  University  of  Oregon  and  High/Scope  third  grades 
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Table  88 


IMPLEMENTATION  SCORES  COMPARED  BY  SIZE 
OF  THE  FOLLOW  THROUGH  SITES 


Implementation 

Small 

Med  ium 

Big 

Score 

Rural  Town 

City 

City 

City 

Total 

90 

2 

1 

3 

85 

1 

/ 

H 

5 

80 

1  A 

A 

A 

2 

15 

\ 

75 

1 

5 

9 

9 

2A 

70 

1  1 

A 

6 

5 

17 

65 

1 

A 

5 

60 

2 

2 

55 

1 

1 

50 

Total 

2  8 

U 

20 

28 

72* 

Includes  scores  of  both  first  and  third  grades. 


in  New  York  City  were  comparatively  low  and  the  between-classroom  variance 
in  New  York  was  high  for  University  of  Oregon,  High/Scope  and  University 
of  Kansas.     In  Philadelphia,  EDC  has  low  implementation  scores  for  both 
first  and  third  grades  as  well  as  high  within-site  variance  and  Bank  Street 
had  low  scores  for  three  ot  the  third  grades.     University  of  Kansas,  bow- 
ever,  had  high  implementation  scores  and  little  variation  between  classrooms 
in  both  grade  levels  in  Philadelphia.     Perhaps  the  teacher  strikes  in 
Philadelphia  made  it  difficult  to  implement  the  more  open  models  represented 
by  Bank  Street  and  EDC  since  under  stress  there  may  be  the  tendency  to  be- 
come more  structured.     In  Newark  all  of  the  first  grades  scored  below  the 
Non-Follow  Through  mean.     The  third  grades  scored  close  to,  but  not  below, 
the  Non-Follow  Through  mean.     The  variation  between  the  classroom  scores 
is  very  slight.     The  Newark  site  has  all  of  the  problems  of  the  stereo- 
typical inner-city  school;  the  poverty  rate  is  high,  few  adults  over  25 
have  a  high  school  education,  the  community  varies  in  its  opinion  of  the 
goals  for  the  schools,  and  the  sponsor  reported  difficulty  in  providing 
adequate  classroom  service  during  the  first  several  years  of  sponsorship. 

In  general,  small  sites  such  as  Smithfield,  Greeley,  Portageville , 
Tupelo,  Tuskegee  and  Lebanon  were  implemented  more  consistently  at  both 
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ERLC 


grade  levels  and  they  had  higher  implementation  scores  in  both  grades. 
This  seems  to  indicate  that  the  educational  change  represented  by  the 
Follow  Through  sponsors  may  be  instituted  more  successfully  in  the  smaller 
cities  and  towns  than  in  the  large  inner-city  schools.     There  are  excep- 
tions, of  course;  University  of  Kansas  was  successful  in  both  grade  levels 
in  Philadelphia.     Table  88  indicates  that  no  rural  area,  town  or  small 
city  had  implementation  scores  lower  than  70  (see  Table  88). 

The  conformity  of  the  teachers'  reports  of  their  classroom  practices 
are  not  likely  to  have  happened  by  chance.     The  influence  of  the  sponsors 
is  apparent  both  in  the  implementation  scores  reflecting  classroom  practice 
and  the  ceacher  reports  of  their  procedures. 
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Chapter  VI 

THE  NATURE  OF  DIFFERENCES  AMONG  SPONSORS 


The  study  of  implementation  and  exportability  in  Chapter  V  included 
comparisons  of  each  Follow  Through  prog  -^m  with  Non-Follow  Through.  In 
Chapter  VI,  we  examine  the  nature  and  degree  of  differences  among  Fgllow 
Through  programs  by  comparing  classroom  processes  among  sponsors.  That 
there  are  major  differences  among  sponsors  in  terms  of  observational 
data  has  been  documented  in  several  prior  evaluations  of  Follow  Through 
classroom  observation  (Stallings,  1973;  Stallings,  Baker,  and  Steinmetz, 
1972).     Rather  than  replicating  the  extensive,  detailed  analyses  pei- 
formed  in  prior  evaluations,  we  will  address  the  following  questions: 

-  IVhat,  if  any,  are  the  major  dimensions  that  differentiate  the 
classrooms  of  the  several  sponsors? 

-  UTiat  classroom  observation  variables  contribute  to  these 
dimensions? 

-  How  are  sponsors  differentiated  on  these  dimensions? 

-  To  what  degree  can  classrooms  be  identified  with  their  correct 
sponsor  by  using  the  classroom  observation  data? 


A.  Methodology 

In  past  reports,  differences  among  sponsors  have  been  examined  in 
two  ways : 

(1)  F-tests  with  Newman-Keuls  multiple  comparisons  on  each 
variable . 

(2)  Factor  analysis  on  a  selected  set  of  CO  variables  and 
comparisons  of  factor  scores  among  sponsors. 

With  both  techniques,  differences  among  sponsors  have  been  delin^ 
eated.     Neither  technique  is  particularly  well  suited  to  answer  the 
foregoing  questions,  however.     The  first  technique  suffers  from  the 
lack  of  data  reduction;  i.e.,  we  come  up  with  as  many  F-tests  as  there 
are  vr^riables.     From  the  results  of  these  tests  we  must  piece  together 
the  major  differences  among  sponsors.     The  first  technique  also  suffers 
from  the  fact  that  the  multiple  F-tests  are  not  independent.     The  F- 
tests  for  correlated  variables  yield  results  that  are  redundant  to  an 
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unknown  degree  and  nominal  significance  levels  do  not  take  this  redun- 
dancy into  account.    Factor  analysis  provides  a  way  of  reducing  a  large 
number  of  variables  to  a  few  factors,  which  account  for  iLost  of  the 
variability  among  classrooms.    However,  this  procedure  does  not  have 
a  criterion  of  discrimination  among  sponsors;  i.e.,  the  factors  that 
account  for  variability  among  classrooms  may  not  necessarily  account 
for  variability  among  sponsors. 

The  analysis  we  perform  here  consists  of  two  parts.     In  the  first 
part,  we  perform  a  multiple  discriminant  analysis.     (See  Cooley  and 
Lohnes,  1962,  and  Rao,  1965,  for  details  concerning  this  technique.) 
From  a  set  of  classroom  observation  variables,  new  variables,  called 
discriminant  functions  are  generated,  each  of  which  is  a  linear  combina- 
tion of  the  original  COX  variables.*    These  discriminant  functions  have 
the  property  that  they  maximize  the  variabilit>  among  sponsors  relative 
to  within-sponsor  variability.     The  discriminant  functions  can  be  viewed 
as  major  dimensions  on  which  sponsors  or  groups  of  sporsors  are  distin- 
guished . 

The  second  part  of  the  analysis  consists  of  a  classification  pro-- 
cedure.     (See  Anderson,  1958,  for  details  concerning  this  technique-) 
The  "best"  (most  effective)  linear  functions  for  classifying  classrooms 
by  sponsor,  under  multivariate  normal  theory,  are  derived  based  on 
selected  COX  variables.    Then,  based  on  these  classification  functions, 
each  classroom  is  matched  with  the  sponsor  it  was  most  likely  to  have 
come  from;  i.e.,  we  act  as  if  we  do  not  know  which  sponsor  the  class- 
room is  affiliated  with  and  we  identify  the  sponsor  the  classroom  is 
most  likely  to  have  come  from.    This  operation  determines  how  reliably 
a  classroom  can  be  identified  with  the  correct  sponsor  or,  conversely, 
how  often  it  is  confused  with  the  program  of  another  sponsor.  Ob- 
viously, if  the  sponsor  of  a  classroom  can  be  identified  correctly  in 
this  way,  then  differences  among  sponsors  are  quite  apparent,  and 
systematic  observation  by  means  of  the  COX  can  reveal  them. 

Portions  of  the  discriminant  analysis  and  the  classification  analy- 
sis are  based  on  assumptions  of  multivariate  normality  and  homogeneous 
within-sponsor  covariance  matrices.    As  was  discussed  in  Chapter  V, 
many  of  the  classroom  observation  variables  have  clearly  nonnormal  dis- 
tributions.    Xt  is  also  doubtful  that  the  within-sponsor  covariance  ma- 
trices are  homogeneous.     Hence,  the  optimal  properties  of  these  tech- 
niques are  only  roughly  approximated,  at  best.     Xn  such  circumstances, 
these  analyses  should  be  looked  upon  as  heuristic  exercises  for  trying 
to  achieve  a  be,tter  understanding  of  the  differences  among  sponsors. 


^Because  of  analytic  constraints  associated  with  this  technique,  the 
number  of  discriminant  functions  that  can  be  generated  is  the  minimum 
of  the  number  of  COX  variables  and  one  less  than  the  number  of  groups. 
For  the  analyses  we  performed,  the  number  of  canonical  variables 
generated  was  six  (the  number  of  sponsors  minus  one). 
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Separate  analyses  were  run  on  four  sets  of  daU  , 

(1)  Selected  PEI*  and  CCL*  variables — first  grade  classrooms 

(2)  Selected  PEI  and  CCL  variables—third  grade  cla  ssrooms 

(3)  Selected  FMO*  variables — first  grade  classrooms 

(4)  Selected  FMO  variables — third  grade  classrooms. 

The  analysis  of  the  PEI  and  CCL  variables  allowed  determination  of 
the  environmental  components  that  distinguish  the  sponsors.    These  en- 
vironmental variables  describe  the  grouping  patterns  of  adults  and  chil- 
dren, the  relative  amount  of  time  spent  in  certain  activities,  and  the 
physical  equJ.-ment  used.    The  analysis  of  the  selected  FMO  variables  per 
mitted  determination  of  the  classroom  interaction  variables  distinguish- 
ing the  sponsors.    Appendix  R  contains  the  list  of  environmental  and  FMO 
variables  and  the  means  and  standard  deviations  for  each  sponsor  by  grad 
level.    A  ♦•otal  of  45  environmental  variables  and  32  FMO  variables  en- 
tered the  respective  analyses.    The  selection  of  variables  to  be  entered 
into  the  analyses  took  into  consideration  the  following: 

(1)  Results  from  range  tests  of  differences  among  sponsor 
means^  performed  for  1971-1972  analyses — To  some  extent 
evidence  was  already  available  on  which  variables  differ- 
entiated sponsors.    The  discriminant  analyses  would  add 
to  this  by  providing  information  on  the  relative  weights 
of  these  variables. 

(2)  The  i-nplementation  variables  employed  extensively  in 
earlier  sections  of  this  report — Those  variables  which 
the  sponsors  are  attempting  to  influence  in  the  classroom 
may  be  very  closely  linked  to  nhe  characteristics  that 
differentiate  sponsors. 

(3)  The  selection  of  four  or  five  variables  for  each  sponsor, 
for  a  total  of  between  30  and  35 — Unless  there  were  several 
variables  advocated  by  each  of  the  sponsors,  some  important 
differences  were  like"'y  to  be  ignored. 

The  stepwise  discriminant  analysis  program,  BMD  07M,  from  the 
Biomedical  Statistical  Package  of  programs  (BMD  Biomedical  Computer 
Program,  1973)  was  used.     The  classroom  was  the  unit  of  analysis. 
In  a  preliminary  phasp,  the  program  selects  a  subset  of  the  variables 
for  inclusion  in  each  analysis.    Variables  are  entered  for  inclusion 


'^SeR  Chapter  III  for  a  detailed  description  of  the  variables  classified 
as  PEI  (Physical  Environment  Information),  CCL  (Classroom  Check  List), 
and  FMO  (Five-Minute  Observation), 
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one  at  a  time  until  none  of  the  variables  that  remain  differentiate 
among  sponsors.    \fhe  criterion  for  differentiation  among  sponsors  was 
*-haL  the  F  value  f\?r  testing  differences  among  sponsors  conditioned  on 
the  variables  that         already  entered  was  significant  at  the  .05  level. 

Table  89  shows  the  number  of  classrooms  that  entered  the  analyses. 
Classrooms  that  had  no  child  focus  observations  were  omitted  from  all 
the  analyses.     Since  only  differences  among  sponsors  were  of  interest, 
Non-Follow  Through  classroo»ns  were  not  included  in  the  discriminant  anal- 
ysis phase. 


Table 

NUMBER  OF  CLASSROOMS  INCLUDED 
BY  SPONSOR  AND 


89 

IN  THE  DISCRIMINANT  ANALYSIS 
GRADE  LEVEL 


First 

Third 

Grade 

Grade 

Far  West  Laborato»-y 

20 

19 

University  of  Arizona 

22 

24 

Bank  Street  College 

18 

18 

University  of  Oregon 

19 

18 

University  of  Kansas 

16 

15 

High/Scope 

18 

19 

EDC 

19 

17 

Total 

132 

130 

B.  Results 

First  to  be  tested  was  the  preliminary  question  about  whether  there 
were  overall  differences  among  sponsors.  (Appendix  R  contains  the  means 
and  standard  deviations  for  each  sponsor  by  grade  level.) 

The  approximate  F-statistic  and  degrees  of  freedom  to  test  whether 
the  mean  vectors  of  the  variables  included  in  the  analysis  were  differ- 
ent among  sponsors  are  presented  in  Table  90  for  each  analysis.  Also 
included  is  the  number  of  variables  that  entered  each  analysis. 

These  statistics  support,  not  very  surprisingly,  the  hypothesis 
that  there  are  significant  differences  among  the  sponsor  means  on  the 
selected  variables. 


1.      The  Discriminant  Functions 


The  next  question  to  be  examined  was  the  relative  power  of 
the  discriminant  functions  (or  major  dimensions)  to  discriminate  among 
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sponsors.    The  eigenvalues  for  the  six  discriminant  functions,  the 
percentage  of  the  total  discriminating  power^  contained  in  each  dis- 
criminant function,  and  the  cumulative  percentage  of  total  discriminate 
ing  power  are  presented  for  each  of  the  four  data  sets  in  Table  91, 
It  is  the  relative  magnitude  of  the  eigenvalues,  as  measured  by  the 
percentage  of  the  total  discriminating  power,  that  indicates  the  rela- 
tive strength  of  the  associated  discriminant  functions  to  distinguish 
among  sponsors. 

The  differences  among  sponsors  on  the  first  three  discriminant 
functions  account  for  over  80%  of  the  total  discriminating  power  that 
can  be  achieved  with  ail  six  possible  functions.     Thus,  the  first  three 
functions  provide  most  of  the  discrimination  that  can  be  achieved  and 
interpretations  will  not  be  attempted  tor  functions  beyond  the  first 
three*     In  fact,  the  major  focus  will  be  on  the  firrt  two  functions 
which  account  for  at  least  65%  cf  the  discriminating  power  in  all  data 
sets. 

For  both  the  environmental  variables  and  the  FMO  variables,  the 
eigenvalues  corresponding  to  the  first  two  discriminanu  functions  for  the 
first  grade  are  larger  than  the  corresponding  values  for  the  third  grade. 
This  is  an  indication  that,  as  we  shall  see,  differences  among  sponsors 
are  more  pronounced  at  the  first  grade  than  at  the  third  grade.  Since 
there  are  program  differences  between  the  two  grade  levels  for  several 
sponsors,  the  difference  in  discriminatory  power  is  not  surprising.  The 
differences  between  first  and  third  grades  are  examined  further  in  the 
detailed  analyses  below* 

Since  a  discriminant  function  is  a  linear  function  of  the  ob-- 
served  variables,  it  is  necessary  to  consider  the  observed  variables  that 
receive  large  weights,  in  ovder  to  give  any  interpretive  meaning  to  a 
function*     This  process  is  analogous  to  the  interpretation  of  factors  in 
a  factor  analysis  in  terms  of  the  observed  variables  witii  large  factor 
loadings.     Typically,  however,  the  discriminant  functions  will  be  more 
complex  tiian  factors  that  have  been  rotated  to  achieve  simple  structure. 
In  other  words,  a  discriminant  ft.\nction  is  apt  to  have  more  variables 
that  receive  substantial  weights  than  would  be  the  case  in  a  factor 
analysis  where  good  simple  Gtructure  was  achieved. 


^^The  percentage  of  the  total  discriminating  power  ascribed  to  a  par- 
ticular discriminant  function  is  defined  as 


100  ' 


where  Xi  is  the  eigenvalue  corresponding  to  the  i^th  discriminant  func- 
tion. 
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The  weights  that  define  a  /discriminant  function  in  terms  of 
the  observed  variables  are  normalized,  i.e.,  they  are  scaled  such  that 
the  sum  of  the  squared  weights  for  all  observed  variables  on  a  single 
discriminant  function  is  equal  to  unity.     The  normalized  discriminant 
function  weights  are  useful  for  computing  the  discriminant  function 
scores  for  the  classrooms.     They  are  not  the  best  weights,  however,  for 
purposes  of  interpretation,  because  they  are  influenced  by  the  standard 
deviations  of  the  observed  variables.     Since  the  standard  deviations  of 
the  observed  variables  are  dependent  on  arbitrary  scale  characteristics 
of  those  variables,  they  have  no  fundamental  interpretive  meaning. 
Hence,  the  weights  that  are  used  for  purposes  of  interpretation  are 
scaled  by  multiplying  the  normalized  weights  by  the  within-group  standard 
deviation  of  the  corresponding  observed  variable.     In  this  way  the  weights 
used  for  interpretation  are  adjusted  for  differences  in  the  standard  de- 
viations of  the  observed  variables. 

The  scaled  coefficients  for  the  first  three  discriminant 
functions  are  displayed  in  Tables    92-95  for  the  four  data  sets.  The 
first  three  discriminant  functions  evaluated  at  the  sponsor  means  aro 
displayed  at  the  bottom  of  the  tables  appropriately  for  each  data  set. 
Only  the  first  three  discriminant  functions  were  examined,  since  in  all 
cases  they  accounted  for  at  least  80%  of  the  discriminating  power.  The 
means  and  standard  deviations  for  each  sponsor  on  each  variable  that  in- 
itially entered  the  analysis  are  displayed  in  Appendix  R. 


a.      The  PEI  and  CCL  Variables — First  Grade 

Nineteen  variables  entered  this  discriminant  analysis  (see 
Table  92),     The  first  discriminant  function  relates  to  the  configuration 
of  adults  and  children  in  the  classroom.    The  variables  with  high  posi- 
tive scaled  coefficients^^  included  Var.  118  (All  children  independent), 
Var.  164  (Personalized  instruction  in  reading),     and  Var.  241  (Puzzles, 
games/Academic  activities).     Those  with  high  negative  scaled  coefficients 
were  Var.  Ill  (Small  group  with  any  adult)  and  Var.  127  (Large  group  with 
aide/Math).    The  scale  appears  to  run  from  a  less-structured  configuration 
where  children  tend  to  work  independently  and  work  with  adults  on  a  per- 
sonalized basis  (one  or  two  children  at  a  time)  to  a  structured  classroom 
configuration  where  children  tend  to  work  with  adults  in  small  or  large 
groups.    An  examination  of  the  values  of  the  discriminant  function  eval- 
uated at  the  sponsor  means  indicates  that  University  of  Kansas  and  Uni- 
versity of  Oregon  are  at  one  extreme  (-3.81  and  -1.67,  respectively)  and 
Far  West  and  EDC  are  at  the  other  extreme  (2.55  and  1.92,  respectively). 
University  of  Kansas  and  University  of  Oregon  have  extreme  low  means  on 
Var.  241  (Puzzles,  games/Academic  activities)  aid  personalized  instruc- 
tion in  reading,  and  extremely  high  means  on  Var.  127  (Large  group  with 


*A  coefficient  was  considered  high  if  its  absolute  value  was  greater 
than  .4.    This  criterion  v^as  established  in  a  preliminary  examination 
of  the  coefficients. 
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Table  92 


STANDARD  IZl'D  C01:FFIC  I  bNTS  FOR  THE  DISCRIMINANT  ANALYSIS: 
FIRST  GRADi:,  Pfl  AND  CCi.  VARIABLKS 


Within         Discrimi  nan t 
Var.  Sponsor  Funct  ions 


No. 

Variable  Name 

S.D. 

i 

2 

3 

25 

Games ,  Coys  ,  p lay  equipment  present 

1  . 

58 

-.03 

-  .24 

-.71 

66 

Numbers,  math,  arithmetic 

7. 

70 

-.13 

.55 

.05 

69 

Science,  natural  world 

3. 

65 

.34 

-  .38 

.12 

83 

Wide  variety  of  activities,  over  on^  day 

1. 

70 

-.25 

-  .42 

-.16 

92 

Aide  with  one  child 

11. 

55 

-.07 

.08 

.52 

94 

Aide  with  small  f^roup 

21. 

29 

-.17 

.94 

-.11 

111 

Small  group  of  children  with  any  adult 

16. 

10 

-.53 

-1.53 

.  42 

118 

All  children,  independent 

10. 

22 

.56 

.00 

-.09 

122 

Small  group  with  teacher/Math 

16. 

80 

.  15 

.05 

-.24 

127 

Large  group  with  aide/Math 

13. 

07 

-.52 

-  .48 

.22 

145 

Small  group  with  teacher/Reading 

11. 

27 

.24 

.44 

-.26 

IA6 

Large  group  with  teacher/Reading 

15. 

16 

.  33 

-  .29 

.20 

149 

Small  group  with  aide/Reading 

15. 

75 

.09 

.36 

-.08 

164 

Personalized  instruction  in  reading 

4. 

65 

.46 

.03 

.27 

2  30 

Aide  involved/Classroom  Management 

12. 

53 

-.25 

.44 

-.33 

233 

Among  adults  and  children/Social  Interaction 

4. 

39 

.35 

.05 

.18 

234 

Among  chi Idren/'Soc ial  Interaction 

4. 

10 

.  10 

.04 

.25 

2  39 

Math  or  science  equipment/Academic  Activities 

22. 

62 

-.05 

-  .75 

.00 

241 

Puzzles,  games/Academic  Activities 

15. 

71 

.61 

-  .27 

.22 

DISCRIMINANT  FUNCTIONS  EVALUATED  AT  THE  SPONSOR  MEANS 


Discriminant  Functions 


Sponsor 

1 

2 

3 

Far  West 

2 

.55 

-  .42 

1.75 

University  of  Arizona 

.26 

.32 

-1.23 

Bank  Street  College 

.33 

-  .22 

-  .93 

University  of  Oregon 

-1 

.67 

2.70 

.  73 

University  of  Kansas 

-3 

.81 

-1.93 

.82 

High/Scope 

.36 

-  .44 

-  .78 

EDC 

1 

.92 

-  .37 

-  .23 
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aide/Math),     Far  West  and  EDC,  on  the  other  hand,  have  extremely  low 
means  on  Var.  Ill  (Small  group  with  any  adult)  and  extremely  high  means 
on  Var.  164  (Personalized  instruction  in  reading). 

The  second  discriminant  function  places  the  University  of 
Oregon  at  the  positive  end  of  the  continuum  and  the  University  of  Kansas 
at  the  negative  end.    The  University  of  Arizona  has  a  small  positive 
mean  on  the  second  function  and  -he  other  four  sponsors  are  tightly 
clustered  with  small  negative  values  on  this  function.    The  variables 
with  large  positive  scaled  weights  (greater  than  .4)  in  decreasing  order 
of  magnitude  were  Var.  94  (Aide  with  small  group),  Var.  66  (Numbers, 
math,  arithmetic),  Var.  145  (Small  group  with  teacher/Reading),  and 
Var.  230  (Aide  involved/Classroom  management).    The  variables  with  large 
negative  weights  were  Var.  Ill  (Small  group  of  children  with  any  adult), 
Var.  239  (Math  or  science  equipment/Academic  activities),  and  Var.  83 
(Wide  variety  of  activities,  over  one  day). 

A  problem  in  interpreting  the  meaning  of  this  dimension  may 
arise  from  an  anomaly  in  the  data.    University  of  Kansas  has  an  extremely 
high  mean  on  Var.  239  (Math  or  science  equipment/Academic  activities)* 
This  appears  to  be  due  to  an  observer  at  one  site  who  may  mistakenly 
have  coded  the  tokens  used  in  the  University  of  Kansas  model  as  math 
equipment.     Since  Var.  239  does  anter  this  analysis  with  a  high  negative 
weight,  the  distance  between  University  of  Oregon  and  University  of  Kan- 
sas on  the  second  variable  may  be  too  large.     (This  one  variable  accounts 
for  1.3  units  of  the  4.6  units  that  separate  the  two  sponsor  means.) 

Variable  239  (Math  or  science  equipment /Academic  activi-^ 
ties)  would  still  serve  to  separate  the  University  of  Oregon  from  all 
other  sponsors  even  if  the  University  of  Kansas  mean  were  not  spuixously 
high.     If  it  is  assumed  that  the  University  of  Kansas  mean  is  too  high 
oa  this  variable;  however,  the  second  discriminant  function  would  serve 
mainly  to  separate  the  University  of  Oregon  from  all  other  sponsors. 
From  an  inspection  of  the  means  of  the  variables  with  large  weights  on 
the  second  function,  it  appears  that  rauch  of  the  uniqueness  of  the  Uni- 
versity of  Oregon  cn  this  function  is  due  to  a  relatively  high  mean  on 
Var.  66  (Numbers,  math,  arithmetic)  and  a  very  low  mean  on  Var.  239  (Math 
or  science  equipment/Academic  activities). 

Figure  33  is  a  plot  of  che  first  discriminant  function 
along  the  horizontal  axis  against  the  second  discriminant  function  along 
the  vertical  axis  for  first  grade  PEI  and  CCL  variables.     Each  letter 
i^icates  the  sponsorship  of  the  corresponding  classroom.    Each  asterisk 
represents  sponsor  means.    The  dollar  <;ign  represents  overlap  of  class- 
rooms.   As  can  be  seen  in  Fipurc  33,  the  firsc  two  functions  together 
divide  the  seven  sponsors  into  four  relatively  distinct  clusters.  Uni- 
versity of  Kansas  and  University  of  Oregon  classrooms  stand  out  in  dis- 
tinct clusters.     Far  West  and  EDC  cluster  together  apart  from  the  other 
sponsors  and  the  remaining  three  sponsors  form  the  fourth  cluster. 

The  first  two  discriminant  functions  together  account  for 
68%  of  the  discriminating  power  of  all  six  possible  functions  (see  Table 

208 


8 

8 
D 


I   I   '  1 
lU  D  a  D  3  I  2 


s 


^  1  i  ^  o  &  9 


<5  2  ^  o 


5  I 


t  I  i  : 
CD    O    ^  X 


<  4 

o 

X 

o 


U.  UJ 

Ui 

U.  UJ  u. 

U. 

u.  <t 

UJ 

U 

u 

UJ 

UJ 

X 

UJ 

UJ 

0. 

UJ 

4 

4 

UJ 

X 

4 

(T  a 

ct 

a 

4 

4  < 

« 

I 

4 

u. 

4 

r 

X 

UJ 

I 

4 

4 

CD 

< 

2D 

I 

UJ 


X  X 
4 


o 
c 


X 


c 
IT 
*0 


o 

IT 


0 


o  ^ 
in  H 

t  z 


c 
I 


• 

• 

• 

• 

m 

• 

« 

• 

• 

• 

• 

c 

C 

c 

c 

c 

c 

in 

ID 

in 

in 

in 

in 

in 

in 

in 

JO 

GO 

CO 

ao 

CO 

• 

• 

• 

• 

• 

• 

• 

• 

« 

IT 

9 

1 

1 

1 

1 

c 

IT 


NOllONnd  INVNIMIUOSia  ONOOSS 


209 


91).    While  relatively  less  powerful,  the  third  function  accounts  for  an 
additional  14%.    The  third  function  has  large  positive  scaled  weights  on 
Var.  92  (Aide  with  one  child)  and  Var.  Ill  (Small  group  of  children  with 
any  adult).    Only  Var.  25  (Games,  toys,  play  equipment  present)  has  a 
negative  weight  greater  than  .4  in  absolute  value  on  the  third  functiuu. 
When  the  third  discriminant  function  is  evaluated  at  the  sponsor  means, 
the  Far  West  Laboratory  is  found  to  lie  at  the  positive  end  of  the  con- 
tinuum and  the  University  of  Arizona  at  the  negative  end. 


b.      The  PEI  and  CCL  Variables — Third  Grade 

Seventeen  variables  entered  this  analysis  for  third  grade 
PEI  and  CCL  variables  (see  Tablo  93).    The  first  discriminant  function 
relates  to  the  configuration  of  the  classroom  and  the  amount  of  arts 
and  crafts.    Variable  82  (Wide  variety  of  activities,  concurrent)  was 
the  only  variable  with  a  positive  scaled  weight  greater  than  .4.  Vari^ 
able  126  (Small  group  with  aide/Math)  and  Var.  127  (Large  group  with 
aide/Math)  had  positive  weights  of  .39  and  .36,  respectively  (see  Table 
98).    The  high  negative  weights  were  obtained  on  Var.  83  (Wide  variety 
of  activities,  over  one  day),  Var.  86  (Teacher  with  one  child),  Var.  118 
(All  children  independjent) ,  and  Var.  64  (Arts,  crafts).    The  high  weights 
of  opposite  sign  for  Var.  82  (Wide  variety  of  activities,  concurrent)  and 
Var.  83  (Wide  variety  of  activities,  over  one  day)  has  the  cumulative  ef- 
fect of  giving  high  negative  weights  to  classrooms  that  have  many  activ- 
ities over  the  day,  but  a  moderate  number  of  activities  occurring  concur- 
rently.*   Far  West,  Bank  Street,  and  EDC  classrooms  appear  to  have  this 
activity  pattern,  with  more  arts  and  crafts  and  more  independent  children 
(see  Appendix  R) . 

The  way  sponsors  were  aligned  along  the  first  dimension 
was  very  similar  to  what  was  found  for  the  first  grade  with  a  reversal 
in  direction.    University  of  Kansas  and  University  of  Oregon  are  at  one 
extreme  (with  more  small  and  large  groups  with  aide  in  math)  with  means 
of  2.75  and  1.7*8  respectively,  and  Far  West  and  EDC  are  at  the  other 
extreme  (with  more  arts  and  crafts  and  a  wide  variety  of  activities 
over  the  day)  with  means  of  -1.19  and  -1.27  respectively.    As  in  the 
first  grade,  the  first  function  seems  to  correspond  to  a  dimension  of 
the  degree  of  classroom  structure  and  activities. 

The  second  function  also  relates  to  the  configuration  of 
the  classrooms.    Variable  83  (Wide  variety  of  activities,  over  one  day) 
and  Var.  Ill  (Small  group  of  children  with  any  adult)  have  high  positive 
scaled  coefficients;  Var.  66  (Numbers,  math,  arithmetic)  and  Var.  118 
(All  children  independent)  have  high  negative  scaled  coefficients.  High/ 


*Those  classrooms  where  the  number  of  concurrent  activities  occurring 
was  low  also  tended  to  have  a  low  number  of  activities  occurring  over 
the  day  (see  Table  R-2  in  Appendix  R) . 


210 


ERIC 


0_ 


Table  93 


STANDAKDIZn)  a)KFFl(:iKNTS  FOR  TH!:  DISCRIMINANT  ANALYSIS: 
THIRD  CR.\I)D,  \>VA  AND  CCL  VAKIABLF.S 


Var. 

Within 
Sponsor 

Discriminant 
Functions 

No. 

Variable  Name 

S.D. 

1 

2 

3 

25 

Games ,  toys ,  p 1  ay  equipment  present 

1, 

95 

-  7« 

-  OS 

.31 

63 

Story,  music,  dancing 

A. 

39 

—  1  1 
.  i  i 

.57 

64 

Arts,  crafts 

4. 

53 

-  Afl 

.38 

66 

Numbers,  math,  arithmetic 

7. 

38 

.  U  J 

.16 

SZ 

Wide  variety  of  activilios,  concurrent 

47 

.  Jy 

.54 

83 

Wide  variety  of  activities,  over  one  day 

1. 

51 

A  A 

.04 

86 

Teaciier  with  one  child 

10, 

19 

-.45 

.  18 

.92 

109 

One  cl.;ld  with  any  adult 

I. 

06 

.21 

-.18  -1 

.33 

111 

Small  group  of  children  with  any  adult 

16. 

55 

-.17 

.48 

.17 

UA 

One  child  independent 

3. 

39 

.20 

.36 

.75 

118 

All  children  independent 

13. 

70 

-.44 

-.73 

.19 

122 

Small  group  with  teacher/Math 

15. 

52 

-.13 

.36  - 

.11 

126 

Small  group  with  aide /Math 

22. 

72 

.39 

.09 

.30 

127 

Large  group  with  aide/Math 

13. 

27 

.  36 

.  11 

.  35 

165 

All  chiHren  independent/Reading 

17. 

09 

-.19 

.19  - 

.72 

229 

Teacher  involved/Classroom  Management 

7. 

80 

.28 

-.19 

.04 

233 

Among  adults  and  children/Social  Interaction 

3. 

96 

-.10 

-.31 

.40 

DISCRIMINANT  FUNCTIONS  EVALUATED  AT  THE  SPONSOR  MEANS 


Discriminant  Functions 
Sponsor   1  2   > 


Far  West 

-1 

19 

44 

-  .77 

University  of  Arizona 

55 

1 

15 

-  .50 

Bank  Street  College 

97 

03 

1.09 

University  of  Oregon 

1 

78 

-I 

80 

-  .81 

University  of  Kansas 

2 

75 

81 

1.01 

Hi  ii;h/Scope 

08 

1 

22 

-  .48 

EDO 

-1 

77 

-1 

26 

.92 
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Scope,  University  of  Arizona,  and  University  of  Kansas  are  on  the  positive 
end  of  the  scale  with  University  of  Oregon  and  EDC  on  the  negative  end 
of  this  dimension. 

Figure  34  displays  the  graph  of  the  first  discriminant 
function  against  the  second  discriminant  function  for  third  grade  PEI 
and  CCL  variables.      University  of  Oregon  and  University  of  Kansas  class- 
rooms form  two  separate  clusters,  although  not  as  distinct  as  in  Figure 
33  for  the  first  grade.     EDC  and  Far  West  classrooms  tend  to  cluster  to- 
gether in  the  lower  left  corner.  University  of  Arizona  and  High/Scope 
classrooms  cluster  together  in  the  upper  left  corner,  and  Bank  Street 
classrooms  are  dispersed  among  these  two  clusters. 

The  third  discriminant  function  has  large  positive  weights 
on  Var.  86  (Teacher  with  one  child),  Var.  114  (One  child  independent) 
and  Var.  63  (Story,  music,  dancing),  while  large  negative  weights  are  ob- 
tained for  Var.  109  (One  child  with  any  adult),  Var.  165  (All  children 
independent/Reading),  and  Var.  82  (Wide  variety  of  activities,  concur- 
rent).    The  interpretation  of  this  dimension  is  unclear  and  it  does  not 
seem  to  have  a  counterpart  in  any  of  the  three  dimensions  at  first  grade 
level.    This  dimension  would  cluster  Bank  Street,  the  University  of 
Kansas,  and  EDC  at  the  positive  end  of  the  continuum  and  the  other  four 
sponsors  at  the  negative  end. 


c.      The  FMO  Variables — First  Grade 

Fifteen  variables  entered  this  analysis  (see  Table  94). 
On  the  first  discriminant  function,  Var.  399a  (Adult  reinforcement  with 
token,  academic)  has  a  very  high  positive  scaled  coefficient  and  Var. 
363a  (Child  group  response  to  adult  academic  command,  request,  or  direct 
question)  has  a  very  high  negative  scaled  coefficient.    An  examination 
of  the  first  discriminant  function  evaluated  at  the  sponsor  means  shows 
that  University  of  Kansas  is  at  the  positive  extreme  with  a  value  of 
6.31  and  University  of  Oregon  is  at  the  negative  extreme  with  -3.50  (see 
Table  94).    The  mean  for  University  of  Kansas  classrooms  on  Var.  399a 
(Adult  reinforcement  with  token,  academic)  is  3.77  with  the  next  highest 
value  being  .25  (see  Appendix  R) .    The  mean  for  University  of  Oregon 
classrooms  on  Var.  363a  (Child  group  responses  to  adult  academic  command, 
request,  or  direct  question)  is  6.56  with  the  next  highest  value  being 
1.68  (see  Appendix  R) •    Thus,  the  first  discriminant  function  is  differ- 
entiating University  of  Kansas  classrooms  from  University  of  Oregon 
classrooms  and  differentiating  these  two  sponsors  from  the  others.  This 
discrimination  is  accomplished  primarily  by  two  items  (adult  reinforcement 
with  token,  academic  and  child  group  response  to  adult  academic  command, 
request,  or  direct  question). 

The  second  discriminant  function  separates  University  of 
Kansas  and  University  of  Oregon  classrooms  from  those  of  the  other  spon- 
sors.    University  of  Kansas  and  High/Scope  have  low  means  relative  to 
other  sponsors  on  the  one  variable  with  a  high  positive  scaled  coeffic- 
ient Var.  441a  (Adult  communication  or  attention  focus,  large  group). 
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Table  94 


STANDARDIZED  COEFFICIENTS  FOR  THE  DISCRIMINANT  ANALYSIS: 
FIRST  GRADE,  FMO  VARIABLES 


Within  Discriminant 
Var.  Sponsor   Functi''^ns 


No. 

Variable  Name 

S.D. 

1 

2 

3 

350a 

Child  questions  to  adults 

oo 

.40 

.35 

.04 

360a 

Child  responses,  academic 

o 

Z . 

Qfi 

.28 

.17 

-  .49 

363a 

Child  group  responses  to  adult  academic 
command ,  reques t ,  or  direct  ques tion 

1. 

25 

1  no 
—  1 .  uz 

.  Oo 

Aauj.L  Lcbpuiibcb        cHiiQ  refjuesc  or 
questions,  nonacademic 

• 

49 

-.46 

-  .50 

-  .18 

374a 

Adult  instruction,  academic 

3. 

16 

-.16 

.12 

.29 

398a 

All  adult  praise  to  children 

1. 

15 

-.07 

-  .44 

-  ,04 

399a 

Adult  reinforcement  with  token,  academic 

63 

.95 

-  .19 

.10 

440a 

Adult  communication  or  attention  focus, 
small  group 

4. 

96 

-  .09 

.17 

-1.14 

441a 

Adult  communication  or  attention  ^ocus, 
large  group 

6. 

16 

.36 

.51 

-  .72 

454a 

Child's  extended  response  to  questions 

47 

.33 

.14 

-  .92 

462a 

All  positive  behavior 

1. 

21 

-.15 

.28 

.23 

509c 

Child  self-instruction,  academic 

7. 

45 

.29 

-.19 

.28 

510c 

Child  self-lnstruction,  objects 

4. 

29 

.03 

.17 

.05 

574c 

Child  movement 

1. 

63 

-.20 

.21 

-  .09 

587c 

All  child  ta::?k-related  comments 

2. 

56 

.09 

.33 

.17 

DISCRIMINANT  FUNCTIONS 

EVALUATED 

AT  THE  SPONSOR 

MEANS 

Discriminant  Functions 

Sponsor 

1 

2 

3 

Far  West 

-  .27 

1.33 

.52 

University  of  Arizona 

.02 

1.45 

-1.98 

Bank  Street  College 

-  .49 

i.25 

.53 

University  of  Oregon 

-3.50 

-3.99 

-  .20 

University  of  Kansas 

6.31 

-2.35 

.08 

High/Scope 

-  .93 

.30 

.60 

EDC 

-  .21 

1.42 

.82 
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Two  of  the  variables  with  high  negative-scaled  coefficients  are  those 
where  either  University  of  Oregon  or  University  of  Kansas  have  high  means 
relative  to  other  sponsors:    Var.  363a  (Child  group  response  to  adult 
academic  command,  request,  or  direct  question),  or  Var.  398a  (All  adult 
praise  to  childr''  . 

The  plot  of  the  first  discriminant  function  against  the 
second  discriminant  function  in  Figure  35  clearly  illustrates  the  dis- 
crimination that  is  b.^-.ng  made  for  first  grade  FMO  variables.  Univer- 
sity of  Oregon  classrooms  are  clustered  in  the  lower  left,  University 
of  Kansas  classrooms  are  cxastered  in  the  lower  right,  and  the  classrooms 
of  the  other  sponsors  are  massed  in  the  middle.    There  was  no  tendency 
for  the  first  two  FMO  discriminant  functions  to  identify  a  Far  West-EDC 
cluster  as  there  was  for  the  PEI  and  CCL  variables.     University  of  Kansas 
classrooms  are  distinguished  primarily  by  the  use  of  tokens  for  reinforce- 
ment.    University  of  Oregon  classrooms  are  distinguished  by  child  group 
responses  to  adult  commands,  requests,  and  direct  questions.  Otherwise 
the  results  are  similar  for  the  two  sets  of  variables  in  that  the  Univer- 
sity of  Kansas  and  the  University  of  Oregon  a^e  most  clearly  separated  as 
distinct  clusters- 

The  third  FMO  discriminant  function  had  a  large  positive 
weight  on  Var.  363a  (Child  group  response  to  adult  academic  command, 
request,  or  direct  question).     Large  negative  weights  (see  Table  94  ) 
are  obtained  for  Var.  440a  (Adult  communication  or  attention  focus, 
small  group),  V^.r.  441a  (Adult  communication  or  attention  focus,  large 
group),  Var.  454a  (Child's  extended  response  to  questions),  and  Var.  360a 
(Child  response,  academic).     Four  sponsors  (Far  West,  Bank  Street,  High/ 
Scope,  and  EDC)  are  clustered  at  the  positive  end  of  this  dimension  while 
the  University  of  Arizona  stands  alone  at  the  negative  end.  University 
of  Arizona  classrooms  appear  to  be  distinguished  from  other  classrooms  by 
their  relatively  aigh  means  on  Var.  454a  (Child's  extended  response  to 
questions),  and  relatively  high  means  on  both  Var.  440a  (Adult  communi- 
cation or  attention  focus,  small  group)  and  Var.  441a  (Adult  communica- 
tion or  attention  focus,  large  group).    Thus,  the  third  FMO  discriminant 
function  is  similar  in  effect  to  the  third  PEI-CCL  function  at  the  first 
grade  in  that  it  tends  to  distinguish  the  University  of  Arizona  from  the 
other  sponsors. 


d.      The  FMO  Variables— Third  Grade 

Fourteen  variables  entered  the  ana^-ysis  (see  Table  95). 
T^e  first  discriminant  function  appears  to  differentiate  sponsors  on  a 
dimension  related  to  the  degree  of  child  interaction  with  adults  and  the 
children's  role  in  the  interactions.    The  variables  with  high  positive 
."scaled  coefficients  were  Var.  363a  (Child  group  responsRs  to  adult  aca- 
demic command,  request,  or  direct  question),  Var.  405a  (All  adult  cor- 
rective feedback  to  children),  Var.  509c  (Child  self-instruction,  aca- 
demic), and  Var.  546c  (Child  waiting).    The  one  variable  with  a  high 
negative  scaled  coefficient  is  Var.  350a  (Child  que'^.tions  to  adults). 
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lable  95 


SlANDARDi/l'D  H)KFFiCliLNMS  FOR  WIW  Dl  SCRI  MI  NAN  I  ANAIYSIS: 
IHIRI)  CRADI  ,  FMO  VAR1ABM\S 


Var. 

Wi  til  in 
Sponsor 

!)isc  riminant 
Func  tions 

Variable  Naint' 

S.l). 

I 

2 

\ 

350a 

Child  questions  to  adults 

1  .  11 

-.44 

.06 

.  32 

Chi  Id  responses,  (.K'adeijii 

J.J/ 

-.32 

-.01 

.  / 

M>3a 

Child  group  responses  to  adult  a«.adeiuii 
eommand »  request,  or  direct  question 

1.55 

.54 

.66 

.91 

Child  presenting  information  to  a  ^roup 

.59 

.  1 J 

.  uz>  - 

.29 

59  A  a 

All   adilt  ai-knowled^^ment  to  i-hildren 

1  .  39 

.  3(? 

-.26 

.27 

398a 

AI i   ddnlt  praise  to  ehildrtu 

1  .03 

.33 

.39 

.49 

)vva 

Adult  re  in lor^  ement  with  token ,  aca- 
demic 

.67 

C  Q 

-  .  DO 

.  14 

-U)5a 

All  adult  I  or  restive  feedback  to  chil- 
dren 

2.02 

.50 

31 

.  36 

'♦12a 

Adult  feedback  to  child  response  to 
adult  academic  ^.ommand,  request,  or 
direct  question 

I  .45 

.29 

.  19  -1 

.01 

>4  38a 

Adult  communication  or  attention  foe us, 
one  child 

5.73 

-.03 

-.60 

.  76 

-UOa 

Adult  eO[iii:iani;.atiuu  or  <ittLiitic)n  fo^us, 
sina  I  I  ^roap 

4 . 99 

-.38 

-.27 

.  76 

♦  b5a 

Adult  feedback  to  children  for  behavior 

1  .01 

-.33 

-.03 

.  79 

509  c 

Child  sel f-ins t rue t ion ,  academic 

8.88 

.50 

.08 

.15 

3A6c 

Chi  I d  wait  ing 

1 .83 

.55 

-.36 

.  10 

DISCRIMINANT  FUNCTIONS  KVALUATEl)  AT  THE  SPONSOR  MEANS 


Discriminant  Funct  ions 


Sponsor 

I 

2 

'3 

Far  West 

-  .56 

.01 

-1.02 

University  of  Arizonri 

-2.04 

-  .00 

1.43 

Bank  Street  College 

.56 

-1 .02 

1.03 

University  of  Oregon 

1.43 

3.43 

.  11 

University  of  Kansas 

3.47 

-1  .69 

.27 

Hi  gh/^  ^ope 

-  .37 

-  .7  7^^ 

-I  .01 

KDC 

-1.24 

-  ..21 

-1.20 
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University  of  Arizona  and  EDC  are  at  the  extreme  negative  end  of  the  di- 
mension with  a  mean  of  -2,04,  respectively.     University  of  Kansas 
and  University  of  Oregon  are  at  the  extreme  positive  end  with  means  of 
3,47  and  1,43,  respectively.     University  of  Arizona  and  EDC  have  rela- 
tively high  means  on  Var,  350a  (Child  questions  to  adults)  and  relatively 
low  means  on  Var,  509c  (Child  self-instruction,  academic)  and  Var,  546c 
(Child  waiting).     On  the  other  hand,  University  of  Oregon  has  an  extremely 
high  mean  on  Vir,  363a  (Child  group  response  to  adult  academic  command, 
request,  or  direct  question),  as  was  found  in  first  grade.     University  of 
Kansas  has  a  relatively  high  mean  on  Var,  509c  (Child  self-instruction, 
academic).     In  addition,  Var,  398a  (All  adult  praise  to  children)  and 
Var,  399a  (Adult  reinforcement  with  token,  academic),  for  which  Univer- 
sity of  Kansas  displays  extremeJy  high  means,  have  moderately  high  posi- 
tive coefficients  that  tend  tc  enhance  the  extremely  high  position  of 
University  of  Kansas  on  the  first  dimension. 

The  second  discriminant  function  appears  to  be  differenti- 
ating the  University  of  Oregon  classrooms  in  the  positive  direction  and 
the  University  of  Kansas  classrooms  in  the  negative  direction  from  the 
other  classrooms.     Variable  363a  (Child  group  responses  to  adult  academic 
command,  request,  or  direct  question)  has  a  high  positive  scaled  co- 
efficient.    Variable  438a  (Adult  communication  or  attention  focus,  one 
child)  and  Var,  399a  (Adult  reinforcement  with  token,  academic)  ha^^e 
high  negative  coefficients.     The  University  of  Oregon  has  a  very  high 
mean  of  5,92  on  Var,  363a  (Child  group  responses  to  adult  academic  com- 
mand, request  of  direct  question),  and  a  very  low  mean  of  14,14  on 
Var,  438a  (Adult  communication  or  attention  focus,  one  child),  as  shown 
in  Appendix  R,     It  appears  that  the  high  negative  weight  on  Var,  399a 
(Adult  reinforcement  with  token,  academic)  has  the  effect  of  depressing 
the  values  of  the  University  of  Kansas  classrooms  on  the  second  dis- 
criminant function  below  that  of  the  other  sp  nsors.     Thus,  the  use  of 
direct  questions  to  groups  and  limited  focus  on  one  child  by  the  Uni- 
versity of  Oregon  and  the  use  of  tokens  by  the  University  of  Kansas 
make  these  sponsors  relatively  uniaue  on  the  second  function. 

The  plot  of  the  first  discriminant  function  against  the 
second  discriminant  function  is  given  in  Figure  36  for  third  grade  FMO 
variables.     As  in  the  other  plots,  the  classrooms  of  the  University  of 
Kansas  model  and  the  University  of  Oregon  model  tend  to  cluster  apart 
from  other  classrooms. 

The  third  FMO  function  at  third  grade  level  bears  con- 
siderable similarity  to  the  third  FMO  function  at  first  grade  level, 
except  that  the  direction  of  the  function  is  reversed  (i,e,,  the  signs 
of  the  weights  are  in  opposite  directions  and  the  sponsor  means  have 
opposite  signs).     Variable  360a  (Child  responses,  academic),  Var,  440a 
(Adult  communication  or  attention  focus,  small  group),  and  Var,   398a  (All 
adult  praise  to  children)  have  large  positive  weights*     Large  tiegative 
weights  are  found  for  Var,  4l2a  (Adult  feedback  to  child  response  to 
adult  academic  command,  request,  or  direct  question),  Var,  363a  (Child 
group  responses  to  adult  academic  command,  request,  or  direct  question), 
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Var.  438a  (Adult  communication  or  attention  focus,  one  child),  and  Var. 
465a  (Adult  feedback  to  children  for  behavior).    The  University  of  Ari- 
zona is  at  the  positive  extreme  of  the  third  function,  with  Bank  Street 
fairly  close  to  it.     Far  West,  High/Scope  and  EDC  are  clustered  at  the 
negative  end  of  the  third  function.    Extensive  use  of  questions  and 
feedback  by  adults  seems  to  be  the  most  characteristic  feature  of  the 
negative  end  of  this  dimension. 


e.      The  YMO  Variables — University  of  Oregon  and  University 
of  Kansas  Excluded — First  Grade 

In  all  the  analyses  carried  out,  the  classrooms  associated 
with  the  University  of  Kansas  and  the  University  of  Oregon  were  clearly 
distinguished  from  each  other  and  from  the  classrooms  of  the  other  spon- 
sors.    In  order  to  examine  the  differences  among  the  classrooms  of  the 
other  five  sponsors,  we  performed  a  discriminant  analysis  on  the  FMO 
variables  for  the  first  grade  with  the  classrooms  of  University  of  Kan- 
sas and  the  University  of  Oregon  omitted.    The  scaled  coefficients  for 
the  first  three  discriminant  functions  are  given  in  Table    96.     The  dis- 
criminant functions  evaluated  at  the  sponsor  meons  are  at  the  lower  part 
of  Table    96.     Thirteen  variables  entered  the  analysis. 

Although  it  appears  that  the  Kansas  and  Oregon  findings 
did  obscure  the  subtler  differences  among  the  other  programs,  the  third 
function  with  Kansas  and  Oregon  present  was  similar  in  effect  to  the 
first  function  with  those  two  sponsors  deleted  (Table    96).     The  first 
discriminant  function  differentiates  University  of  Arizona  classrooms 
from  those  of  the  other  sponsors.     Of  the  thirteen  variables  included, 
nine  had  high  scaled  coefficients  in  either  the  positive  or  negative 
direction.     This  makes  it  very  difficult  to  interpret  the  dimension  in 
simple  tenns.     The  variables  that  appear  to  differentiate  University 
of  Arizona  classrooms  from  the  other  classrooms  are:    Var.  454a  (Child's 
extended  response  to  questions) ,  where  the  University  of  Arizona  class- 
rooms had  a  mean  that  was  about  one  standard  deviation  larger  than  the 
next  largest  mean,  and  Var.  440a  (Adult  communication  or  attention 
focus,  small  group).    Both  variables  are  considered  critical  to  the  im- 
plementation of  the  Arizona  model. 

The  second  discriminant  function  dif f etentiates  the 
High/Scope  program  from  the  others.    The  variables  that  have  high  posi- 
tive scaled  coefficients  and  relate  to  High/Scope's  program  are: 

-  Var.  342a  (Adult  to  child,  verbal). 

-  Var.  363a  (Child  group  responses  to  adult  academic 
command,  request,  or  direct  question). 
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Table  96 


STAN'D\RDrZKD  COKFFlCiFNTS  FOR  THK  DISCRIMINANT  ANALYSIS: 
FIRST  GRADK,  FMO  VARIABLKS 
(University  of  Oregon  and  University  of  Kansas  Omitted) 


Within  Discriminant 


Var. 

Sponsor 

Fund  ions 

No. 

Variable  Name 

S 

.D. 

1 

2 

Adult  to  chiicl,  verbal 

I 

.94 

-1 

.20 

]  .51 

.  76 

350a 

Child  questions  to  adults 

.92 

.54 

-1.26 

.29 

360a 

Child  responses,  academic 

3 

.03 

.57 

-  .99 

-.51 

363a 

Child  group  responses  to  adult  academic 
command,   request,  or  direct  question 

.87 

.77 

.59 

.45 

374a 

Adult  instruction,  academic 

3 

.15 

.27 

-  .16 

.77 

388a 

Child  task-related  comments  to  adults 

1 

.00 

J 

.16 

-  .66 

-.54 

398a 

Ail  adult  praise  to  children 

.57 

.21 

-  .06 

.62 

412a 

Adult  feedback  to  child  response  to 
adult  academic  command,  request,  or 
direct  question 

1 

.47 

.16 

.74 

-.18 

4A0a 

Adult  communication  or  attention  focus, 
small  group 

4 

.78 

-1.00 

.23 

-.11 

441a 

Adult  communic*- '  )n  or  attention  focus, 
large  group 

5 

.53 

.48 

-  .59 

-.08 

444a 

Adult  movement 

1 

.67 

.40 

.26 

.02 

45Aa 

Child^s  extended  response  to  questions 

.43 

-1 

.01 

-  .02 

.  10 

510c 

Child  self-instruction,  objects 

4 

.77 

.08 

.46 

.10 

DISCRIMINANT  FUNCTIONS  EVALUATED  AT  THK  SPONSOR  MEANS 


Discriminant  Functions 
Sponsor   1  2  3 


Far  West 

.47 

-  .99 

J  1.24 

University  of  Arizona 

-2.40 

.03 

-  .14 

Bank  Street  Col  lege 

.79 

-  .08 

-  .66 

High/Scope 

.70 

1.86 

.37 

EDC 

.88 

-  .69 

-  .87 

ERIC 
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-  Var.  412a  (Adult  feedback  to  child  response  to  adult 
academic  command,  request,  or  direct  question). 

-  Var.  510c  (Child  self-instruction,  objects) . 

Large  negative  weights  were  obtained  for  Var.  350a  (Child 
questions  to  adults),  Var.  360a  (Child  responses,  academic),  Var.  388a 
(Child  task-related  comments  to  adults),  ^nd  Var.  441a  (Adult  communica- 
tion or  attention  focus,  large  group). 

Figure  37  displays  *'he  plot  of  the  first  discriminant 
function  against  the  second  discriminant  function  for  first  grade  FMO 
variables  excluding  Universities  of  Oregon  and  Kansas.     Classrooms  as- 
sociated with  the  University  of  Arizona  model  cluster  on  the  middle  left 
side;  most  of  the  classrooms  associated  with  the  High/Scope  model  cluster 
in  the  upper  portion  of  the  plot.     The  other  sponsors  tend  to  cluster  to- 
gether in  an  undifferentiated  mass. 

2 .      Classification  of  Classrooms  by  Sponsor 

Table   97    displays  the  results  of  the  classification  procedure 
for  each  of  the  four  data  sets.     Each  row  entry  in  the  table  is  the  num- 
ber of  the  sponsor's  classrooms  that  were  classified  into  the  sponsor's 
program  identified  by  the  column  label.     The  last  row  indicates  how  Non- 
Follow  Through  classrooms  were  classified  among  sponsors.  Non-Follow 
Through  classrooms  were  classified  in  this  way  so  that  we  could  examine 
the  relative  degree  to  which  the  processes  in  Non-Follow  Through  class- 
rooms are  different  from  the  various  Follow  Through  programs.     For  the 
Follow  Through  classrooms  the  numbers  on  the  main  diagonal  represent 
classrooms  that  were  correctly  classified.     The  numbers  off  the  main  ^ 
diagonal  represent  classrooms  that  were  misclassif ied ;  that  is,  class- 
rooms that  were  not  identified  as  belonging  to  the  correct  sponsor. 
Misclassif ication  occurs  wnen  scores  on  the  ooserved  variables  for  a 
given  classroom  are  more  similar  to  the  mean  score  for  a  sponsor  otlier 
the  .  the  correct  one.     The  Non-Follow  Through  classrooms  cannot  be  in- 
cluded as  correctly  or  incorrectly  classified  since  there  was  no  Non- 
Follow  Through  group  included  in  the  classification  scheme.     For  Non- 
Follow  Through,  we  are  interested  in  the  pattern  of  classification. 

a.      Classification  of  Sponsor's  Classrooms 

If  the  seven  sponsors  included  in  this  study  have  distinct 
programs,  as  measured  by  the  COX,  then  we  would  expect  the  preponderance 
of  classrooms  to  lie  along  the  main  diagonal.     This  is  what  actually  oc- 
curred. 

Of  the  132  first  grade  classrooms,  83%  were  correctly 
categorized  on  the  basis  of  the  nineteen  CCL  and  PEI  variables  and  78% 
were  correctly  categorized  on  the  basis  of  the  fifteen  FMO  variables. 
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Table  97 


CUSSIFICATIOK  OF  CLASSROOMS  BY  SPONSOR 
PEI  and  CCL  Variables,  First  Grade 


Classrooms  Identified  as  Sponsor 


Far 

Univ.  of 

Bank 

Univ.  of 

Univ.  of 

High/ 

Sponsor 

West 

Arizona 

Street 

Oregon 

Kansas 

Scope 

EDC 

Far  West 

18 

2 

0 

0 

0 

0 

0 

University  of  Arizona 

0 

17 

2 

0 

0 

2 

1 

Bank  Street  College 

1 

2 

13 

0 

0 

1 

1 

University  of  Oregon 

0 

0 

0 

19 

0 

0 

0 

University  of  Kansas 

0 

0 

0 

0 

lA 

2 

0 

High/ Scope 

0 

1 

2 

1 

1 

13 

0 

EDC 

2 

0 

2 

0 

0 

0 

15 

Non-Follow  Through 

6 

6 

5 

5 

0 

2 

10 

PEI  and  CCL  Variables, 

Third  Grade 

Classrooms 

Identified 

as  Sponsor 

Far 

Univ.  of 

Bank 

Univ.  of 

Univ.  of 

High/ 

Sponsor 

West 

Arizona 

Street 

Oregon 

Kansas 

Scope 

EDC 

Far  West 

15 

2 

2 

0 

0 

0 

0 

University  of  Arizona 

0 

17 

2 

0 

0 

5 

0 

Bank  Street  College 

3 

1 

11 

0 

0 

0 

3 

University  of  Oregon 

0 

0 

0 

17 

1 

0 

0 

University  of  Kansas 

0 

0 

1 

1 

13 

0 

0 

High/Scope 

2 

3 

0 

0 

1 

12 

1 

EDC 

2 

0 

5 

0 

0 

0 

10 

Non-Follow  Through 

10 

0 

7 

16 

0 

0 

3 

FMO  Variables,  First  Grade 

Classrooms 

Identified 

as  Sponsor 

Far 

Univ.  of 

Bank 

Uni-'.  of 

Univ.  of 

High/ 

Sponsor 

Wesr 

Arizona 

Street 

Oregon 

Kansas 

Scope 

EDC 

Far  West 

15 

1 

3 

0 

0 

0 

1 

University  of  Arizona 

0 

19 

2 

0 

0 

0 

1 

Bank  Street  College 

2 

2 

10 

0 

0 

1 

3 

University  of  Oregon 

0 

0 

0 

19 

0 

0 

0 

University  of  Kansas 

0 

0 

0 

0 

16 

0 

0 

High/ Scope 

2 

0 

0 

1 

0 

13 

2 

EDC 

3 

1 

1 

0 

0 

3 

11 

Non-Follow  Through 

9 

5 

8 

0 

0 

6 

6 

FMO  Variables,  Third  Grade 

 Classrooms  Identified  as  Sponsor 


Far 

Univ.  of 

Bank 

Univ.  of 

Univ.  of 

High/ 

Sponsor 

West 

Arizona 

Street 

Oregon 

Kansas 

Scope 

EDC 

Far  West 

13 

3 

0 

0 

0 

3 

0 

University  of  Arizona 

1 

20 

0 

0 

0 

1 

2 

Bank  Street  College 

0 

1 

15 

0 

0 

1 

1 

University  of  Oregon 

1 

0 

0 

16 

0 

0 

1 

University  of  Kansas 

0 

0 

1 

0 

lA 

0 

0 

High/Scope 

0 

3 

1 

1 

0 

9 

5 

EDC 

0 

0 

0 

0 

0 

1 

16 

Non-Follow  Through 

6 

1 

7 

A 

1 

10 

7 
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Of  the  130  third  grade  classrooms,  73%  were  correctly  categorized  on  the 
basis  of  the  seventeen  CCL  and  PEI  variables  and  79%  were  correctly  cate- 
gorized on  the  basis  of  the  fourteen  FMO  variables.     The  number  of  class- 
rooms that  were  misclassif ied  ranged  from  23  to  34. 

As  might  be  expected  from  the  results  of  Section  B-1,  Uni- 
versity of  Kansas  and  University  of  Oregon  programs  are  most  distinct. 
Their  classrooms  are  rarely  confused  with  the  classrooms  of  other  spon- 
sors and  other  sponsors'  classrooms  are  rarely  identified  with  them.  A 
high  percentage  of  the  classrooms  of  the  University  of  Oregon  and  Univer- 
sity of  Kansas  programs  are  correctly  classified  on  every  analysis  per- 
formed.   The  rate  of  correct  classification  was  at  least  85%  and  reached 
100%  in  three  cases.    Very  few  classrooms  from  other  sponsors  are  mis- 
classified  as  University  of  Oregon  or  University  of  Kansas  classrooms. 

To  highlight  this  result,  Table  98    was  created,  showing 
the  number  of  classrooms  misclassif ied,  and  the  number  of  correct  classi- 
fications summed  over  all  four  analyses.    Note  that  each  classroom  was 
classified  twice — once  on  the  basis  of  the  environmental  variables,  and 
a  second  time  on  the  basis  of  the  FMO  variables.     Each  entry  indicates 
the  number  of  instances  over  the  four  analyses  when  a  sponsor's  class- 
room (row)  was  misclassif ied  into  another  sponsor's  program  (column). 

There  were  114  instances  of  'misclassif ication ,  or  22%  of 
the  524  classifications  made  over  the  four  analyses.     The  data  for  Uni- 
versity of  Oregon  and  University  of  Kansas  were  placed  at  the  ends  of 
the  table  to  make  it  clearer  that  University  of  Oregon  and  University  of 
Kansas  classrooms  were  rarely  misclassif ied  and  the  classrooms  of  other 
programs  were  rarely  classified  in  University  of  Oregon  and  University 
of  Kansas  programs.     There  are  five  instances  of  High/Scope  misclassif ied 
as  University  or  Oregon  or  University  of  Kansas  (see  High/Scope  row  of 
Table   98  )  but  none  of  the  other  four  sponsors  are  ever  misclassif ied  as 
University  of  Oregon  or  University  of  Kansas. 

Table   98    reveals  no  other  pattern  of  clusterings  among 
the  other  sponsors.     Far  West  classrooms  were  confused  most  often  with 
the  University  of  Arizona  and  Bank  Street  programs;  while  the  University 
of  Arizona  classrooms  were  confused  most  often  with  Bank  Street  and  High/ 
Scope  programs.     Bank  Street  classrooms  are  most  frequently  confused 
with  Far  West,  University  of  Arizona,  and  EDC  programs.     EDC  is  confused 
most  frequently  with  Far  West  and  Bank  Street.    Finally,  High/Scope  is 
the  only  sponsor  that  had  instances  of  confusion  with  all  other  sponsors. 

There  are  two  factors  to  be  considered  in  the  distinctive- 
ness of  the  University  of  Oregon  and  the  University  of  Kansas — from  one 
another  and  from  other  sponsors'  classrooms.    There  is  the  fact  that 
both  of  these  programs  specify  behavior  on  the  part  of  the  teacher  that 
is  readily  observable  and  quite  atypical  of  generally  practiced  class- 
room teacher  behavior.     For  example,  in  the  first  grade.  University  of 
Kansas  teachers  are  instructed  to  give  out  plastic  tokens  to  children 
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for  certain  desired  behaviors.     University  of  Oregon  teachers  are  in- 
structed to  get  responses  from  all  children  in  the  small  instructional 
group  when  they  pose  a  question.    This,  too,  is  atypical,  since  children 
in  most  first  grade  classes  (including  children  in  Kansas  classes)  are 
more  often  asked  individually  for  answers.     Bank  Street,  University  of 
Arizona,  High/Scope,  Far  West,  and  EDC  teachers  are  p^forming  differ- 
ently from  one  another.    The  different  emphases  of  the  programs  show  up 
in  the  frequency  patterns  for  different  teacher  behaviors.     But  these 
programs  do  not  each  have  a  unique  behavior  captured  by  a  unique  vari- 
able. 

The  second  factor  responsible  for  the  special  distinctive- 
ness of  these  two  sponsors  is  the  nature  of  the  COI  and  the  variables 
created  from  it.     The  detailed  level  of  the  coded  behaviors  and  the  fine- 
ness of  the  variables  defined  in  the  instrument  favors  distinguishing  be- 
havioristic  models  one  from  another.     A  set  of  variables  defined  more 
grossly,  inclu'ling  patterns  of  behavior  or  styles  rather  than  single 
activities  might  distinguish  Bank  Street  and  Far  West  classrooms  from 
one  another  as  reliably  as  University  of  Kansas  and  University  of  Oregon 
classrooms  are  distinguished  now  by  the  present  set  of  variables. 

b.      Classification  of  Non-Follow  Through  Classrooms 

The  classification  functions  developed  for  the  Follow 
Through  classrooms  were  used  to  classify  the  Non-Follow  Through  class- 
rooms in  order  to  examine  the  relative  degree  to  which  the  processes  in 
Non-Follow  Through  classrooms  are  similar  to  the  various  Follow  Through 
programs.     The  results  are  displayed  in  the  last  row  entry  for  each  data 
set  in  Table  97, 

The  University  of  Kansas*  again,  stands  out  as  distinct. 
No  Non-Follow  Through  classrooms  were  categorized  with  the  Kansas  pro- 
gram with  the  exception  of  one  classroom  in  the  FMO  variables,  third 
grade  data  set.    On  the  other  hand,  the  physical  environment,  grouping 
arrangements,  and  activities  in  Non-Follow  Through  classrooms  may  be 
similar  to  the  University  of  Oregon  classrooms,  relative  to  other  spon- 
sors, especially  in  the  third  grade.     For  the  third  grade,  16  out  of 
the  36  Non-Follow  Through  classrooms  were  classified  with  the  University 
of  Oregon  program.    The  reduced  use  of  small  groups  in  the  third  grade, 
and  the  continued  emphasis  on  academic  activities  such  as  numbers,  math, 
anc  arithmetic  in  the  University  of  Oregon  third  grade  program  may  ex- 
plain the  affinity  of  Non-Follow  Through  classrooms  to  this  sponsor. 

Few  Non-Follow  Through  classrooms  were  identified  with  the 
High/Scope  program  based  on  the  ?El  and  CCL  variables.     Two  classrooms 
were  identified  with  High/Scope  at  the  first  grade  level  and  none  were 
identified  with  High/Scope  at  the  third  grade  level. 
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C.  Summary 


At  the  beginning  of  this  chapter,  four  questions  were  posed.  The 
first  was:    What,  if  any,  are  the  major  dimensions  that  differentiate 
the  classrooms  of  the  several  sponsors?    With  the  possible  exception  ot 
a  "degree  of  structure"  dimension,  the  discriniinant  functions  on  which 
the  sponsors  differed  did  not  seem  to  represent  abstract  concepts,  such 
as  "individualization  of  instruction"  or  "child  initiation"  versus  "re- 
sponsiveness" but  were  dominated       one  or  two  very  specific  classroom 
process  variables,  such  as  "Large  group  with  aide/Math"  or  "Adult  rein- 
forcement with  token,  academic."    One  or  two  individual  variables  shared 
by  one  or  two  sponsors  seem  to  be  the  best  discriminators. 

The  next  question  was:    What  observation  variables  contribute  to 
these  dimensions?    This  must  be  answered  separately  for  the  PEI/CCL  anal- 
yses and  FMO  analyses.    For  the  PEI/CCL  analysis,  the  first  and  third 
grade  results  are  very  similar.    Table  99    shows  the  observation  vari- 
ables with  high  scaled  coefficients  on  the  first  two  dimensions. 

The  results  for  the  FMO  analyses  (Table  100)  differed  between  first 
and  third  grades.    The  fact  that  the  University  of  Kansas  classrooms 
phase  out  their  use  of  material  rewards  (tokens)  by  the  third  grade  may 
partially  explain  the  differences.     In  first  grade,  the  first  canonical 
variable  separates  University  of  Kansas  and  University  of  Oregon  from 
one  another  on  the  basis  of  tokens  versus  group  responses.    The  second 
separates  both  sponsors  from  the  others. 

In  the  third  grade,  the  first  discriminant  function  does  the  same 
thing  (University  of  Kansas  and  University  of  Oregon  versus  others)  as 
the  second  discriminant  function  does  in  first  grade.    The  "tokens" 
variable  no  longer  distinguishes  University  of  Kansas  from  University 
of  Oregon,  and  another  difference  among  sponsors  dominates. 

In  this  discussion  of  observation  variables  with  high-valued  coef- 
ficients, we  have  also  partially  answered  our  third  question:    How  are 
sponsors  differentiated  on  these  dimensions?    In  all  four  analyses  and 
in  the  classification  procedure  the  classrooms  associated  with  the  Uni- 
versity of  Oregon  and  the  University  of  Kansas  models  tended  to  cluster 
apart  from  each  other  and  apart  from  other  sponsors.     In  a  separate  anal- 
ysis without  these  two  sponsors'  classrooms,  the  University  of  Arizona 
was  distinguished  from  the  remaining  four  sponsors  on  the  basis  of  Var. 
454a  (Child's  extended  response  to  questions)  and  Var.  440a  (Adult  com^ 
munication  or  attention  focus,  small  group).    High/Scope  was  differenti- 
ated from  the  other  four  on  the  basis  of  variables  indicating  a  high 
level  of  verbal  interaction  between  adults  and  children  and,  as  would  be 
expected  from  their  Piagetian  model,  Var.  510c  (Child  se'' f-instruction, 
objects).    The  third  discriminant  function  distinguished  Far  West  Lab 
from  EDC  and  Bank  Street  on  the  basis  of  child  questioning  and  all  adult 
praise. 

The  last  question  was?    To  what  degree  can  classrooms  be  identified 
with  their  correct  sponsor  by  using  the  classroom  observation  data?  The 
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answer  is  that  they  can  be  classified  with  a  high  degree  of  accuracy 
overall.    Out  of  a  total  of  524  classifications,  410  were  correct.  Uni- 
versity of  Kansas  and  University  of  Oregon  classrooms  are  rarely  raisclas- 
sified  as  belonging  to  another  sponsor.    The  remaining  five  sponsors' 
classrooms  are  more  confusable  among  themselves  but  only  rarely  with  Uni- 
versity of  Oregon  or  University  of  Kansas.    A  few  High/Scope  classrooms 
were  classified  as  belonging  to  University  of  Oregon  (three  instances)  or 
University  of  Kansas  (two  instances).     In  the  large  majority  of  cases, 
however,  classrooms  affiliated  with  a  particular  sponsor  were  correctly 
identified  with  that  sponsor. 

The  Non-Follow  Through  classrooms  were  most  o      n  classified  as  Far 
West,  University  of  Arizona,  Bank  Street,  Univers''      of  Oregon,  and  EDC 
classrooms.     On  the  third  grade  physical  environm,  .  c  and  checklist  of 
classroom  grouping  and  activities,  the  Non-Follow  Through  classrooms 
were  classified  as  University  of  Oregon  classrooms  16  out  of  36  times. 
It  is  notable  that  the  Non-Follow  Through  classrooms  were  rarely  classi- 
fied as  either  University  of  Kansas  or  High/Scope  classrooms.     The  utility 
of  this  analysis  is  to  provide  a  description  of  the  Non-Follow  Through 
classrooms.     Such  classifications  will  aide  in  understanding  the  partial 
correlations  of  instructional  processes  and  child  outcomes,  which  used 
all  classrooms,  anc^  are  presented  in  Chapter  VII.     For  instance,  if  vari- 
ables which  describe  the  University  of  Oregon  model  are  positively  related 
to  scores  on  the  MAT  reading,  not  only  will  the  process  variables  of  the 
University  of  Oregon  load  on  that  variable,  so  also  will    11  of  the  Non- 
Follow  Through  classrooms  which  operate  similarly  to  the  University  of 
Oregon. 
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Chapter  VII 


i^:STRUCTIONAL  PROCESSES  AS  RELATED  TO  CHILD  OUTCOMES 


All  of  the  information  presented  on  program  implementation  in 
Chapters  V  and  VI  would  be  of  little  value  if  we  did  not  believe  that 
these  instructional  models  have  an  impact  on  child  growth  and  develop- 
ment.    Since  it  seems  clear  at  this  point  that  the  sponsor's  innovations 
were  implemented  in  the  classroom,  we  turn  now  to  the  investigation  of 
the  effects  of  sponsor-specified  instructional  processes  upon  the  chil- 
dren.    The  data  reported  here  were  computed  over  all  classrooms,  sepa- 
rated only  by  grade  level.    This  procedure  was  used  in  ordor  to  investi- 
gate instructional  processes  and  their  relationship  to  child  outcomes 
regardless  of  where  they  occurred.     Since  many  of  the  process  variables 
which  are  correlated  with  child  outcomes  do  describe  components  of  the 
models — especially  as  reiated  to  the  structure  or  flexibility  of  the 
model — we  have  also  reported  sponsor  mean  scores  on  the  outcome  vari- 
ables.    This  allows  comparisons  to  be  made  between  the  overall  correla- 
tions and  individual  sponsor  scores. 

This  study  is  reported  in  two  sections;     Section  A  gives  an  analysis 
usinc  partial  correlations^ and  Section  B  reports  regression  analyses. 
Both  techniques  were  used  tb-«j\nvestigate  the  relationships  between  in- 
structional processes  and  child'**a;.\lcomes .     Table  101  presents,  for  eacn 
sponsor  and  for  Non-Foliow  Through,  the  number  of  sites  and  classrooms 
that  were  used  in  the  analyses,  the  partial  correlations,  and  the  regres- 
sion analysis.     In  order  for  a  classroom  to  be  included  in  these  analyses, 
at  least  20?  of  the  children  in  the  classroom  had  to  have  baseline  test 
data. 


A.      Analysis  Using  Partial  Correlations 

1 .  riethodology 

This  section  deals  with  correlational  data  that  have  been 
adjusted  for  the  baseline  entering  Wide  Range  Achievement  Test  (WRAT) 
scores.     Partial  correlations  were  carried  out  using  child  behaviors  and 
test  scores  as  outcomes  (see  Table  102).     In  the  first  analysis,  six  ob- 
served child  behavior  variables  were  correlated  with  28  instructional 
process  variables  for  both  first  and  third  grades.     First,  instructional 
process  data  were  collected  on  two  days  separate  from  the  child  observa- 
tLO*)s.     The  child  behavior  data  were  then  collected  on  one  day  by  observ- 
ing four  children  per  classroom  and  observing  each  child  five  times  (for 
a  total  of  20  ooservations  per  classroom).     The  28  process  variables  were 
chosen  by  the  authors  on  tho  basis  of  what  processes  might  be  expected 
according  to  previous  analysis  (Stallings,  1973)  to  relate  to  the  chiJd 
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Table  102 


PARTIAL-CORRELATION  ANALYSES 

Number  of  Process  Variables    Number  of  Classrooms 


Child  Behaviors 

First  Grade  28^'  105 

Third  Grade  28  58 

Days  Absent 

First  Grade  340  108 

Third  Grade  340  58 

Raven's— Third  Grade  340  58 

CoopersmiLh — Third  Grade  340  58 

lAR— Third  Grade  340  58 

>!i\T 

First  Grade  340  108 

Third  Grade  340  58 


^*'The  28  variables  are  a  subset  of  the  340  variables  used  in  the  other 
analysis . 

behaviors.     Other  process  variables  might  also  correlate  sij^nif icantly 
with  these  behaviors  but  the  selection  of  the  28  was  an  attempt  to  keep 
the  analysis  as  simple  as  possible.    As  Table  102  indicates,  all  of  the 
classrooms  in  the  observation  sample  that  were  tested  did  not  have  in- 
dividual children  observed;  e.g.,  individual  children  in  one  New  York 
district  were  not  observed  due  to  parental  requests,  and  one  day  of 
child  observations  were  lost  in  the  mail  from  Newark.     Thus,  the  number 
of  classrooms  included  in  the  analysis  of  child  behaviors  is  limited  to 
the  number  of  classrooms  having  both  individual  child  observations  and 
baseline  test  data. 

For  a  more  complete  analysis  of  the  other  outcome  measures, 
340  instructional  variables  were  correlated  with  absence  data  and  test 
scores  for  the  first  and  third  grades  separately.     For  the  first  grade, 
the  MAT  reading  and  arithmetic  test  scores  w^.re  used.     For  the  third 
grade,  in  addition  to  the  MAT  reading  ar.u  arithmetic,  the  Raven's  Coi-- 
oured  Progressive  Matrices,  the  Intellectual  Achievement  Responsibility 
Scale  (lAR),  and  the  Coopersmlth  Self-Esteem  Inventory  scores  were  used 
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in  the  analysis.     Since  there  are  340  instructional  process  variables, 
to  simplify  reporting  only  significant  correlations  (p<,05)  are  reported 
for  the  test  data. 

The  problems  of  interpreting  correlational  data  need  to  be  men- 
tioned.   They  concern  such  pitfalls  as  capitalizing  on  chance  results 
and  drawing  invalid  inferences  from  the  correlations.    The  problem  of 
capitalizing  on  chance  is  compounded  by  the  large  number  of  tests  of  sig- 
nificance that  were  computed.    Of  the  340  partial  correlations  computed 
with  data  on  child  absence  and  test  scores,  approximately  17  significant 
correlations  would  be  expected  to  occur  by  chance  if  the  variables  were 
statistically  independent.     In  the  correlations  on  child  absence,  there 
were  56  first  grade  e  A  65  third  grade  correlations  that  were  found  to 
be  significant.    The  problem  is  that  there  is  no  way  of  estimating  which 
correlations  occurred  by  chance.     Variables  which  correlate  similarly  at 
Doth  first  and  third  grades  probably  can  be  interpreted  with  more  confi- 
dence.    The  strongest  type  of  statement  that  can  be  made  when  interpre- 
ting these  correlations  takes  the  form:     **in  classrooms  where  teachers 
were  observed  to  be  more  positive  toward  children,  the  absence  rate  of 
children  was  lower,"    In  all  the  results  to  be  reported,  it  must  he  un- 
derstood that  correlations  are  compared  between  class  averages.  Infer- 
ences about  the  meaning  of  correlations  at  the  individual  student  level 
are  unwarranted. 

We  cannot  infer  causal  relationships  based  on  correlational 
findings.     We  adjusted  for  the  baseline  WRAT  scores  hoping  to  eliminate 
some  of  the  spurious  relationships;  e,g,,  classes  that  have,  on  the 
average,  a  larger  proportion  of  bright  children  may  tend  to  have  a  higher 
average  of  socioeconomic  status,  have  fewer  absences,  and  have  higher 
test  scores.     Thus,  the  partial  correlation  was  computed  in  an  attempt 
to  remove  associations  between  process  and  outcome  that  might  be  due  to 
the  general  level  of  children  in  a  particular  classroom.     The  results 
from  these  studies  must  be  considered  exploratory  and  useful  primarily 
for  generating  hypotheses  for  other  studies. 

2,      Relationships  Between  Selected  Child  Behaviors 
and  Instructional  Variables 

Follow  Through  sponsors  and  educators  in  general  feel  that  al- 
though the  development  of  basic  skills  is  important,  it  is  also  desir- 
able for  children  to  develop  such  attributes  as  task  persistence,  cooper- 
ation, and  independence.    While  these  attributes  are  elusive,  we  have 
been  able  to  operationally  define  and  systematically  observe  some  com- 
ponents of  these  behaviors.     The  exnansion  of  the  SRI  Classroon  Observa- 
tion Instrument  (COI)  procedure  for  this  purpose  was  stimulated  by  sev- 
eral sponsors  who,  early  in  the  evaluation,  said,  "if  you  want  to  know 
whether  we  are  implemented,  you  must  observe  our  children/'    For  this 
reason,  our  system  was  modified  to  observe  individual  children.  These 
child  observations  have  been  used  not  only  to  evaluate  sponsor  implemen- 
tation, but  also  to  measure  behaviors  such  as  child  task  persistence, 
cooperation.  Independence ,  and  so  on. 
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To  investigate  the  utility  of  these  behaviors  as  child  outcome 
measures,  parti..l  correlations  were  computed.     The  study  is  based  on  105 
first  grade  and  58  third  grade  Follow  Through  and  Non-Follow  Through 
classrooms  (see  Table  102).     Six  child  behaviors  were  selected  as  outcome 
variables:     independence,  task  persistence,  cooperation,  question  asking,'^ 
verbal  initiative,^  and  self-esteem.'^    The  data  were  collected  on  one  day 
and  comprise  20  child-focused  observations.    As  previously  described,  28. 
instructional  process  variables  were  selected  for  use  in  the  correlations 
(see  Table  103)  .    These  data  were  collected  on  two  days  separate  frori 
the  child-focused  observations  in  activity-  or  in  adult-focused  observa- 
t  ior.s. 

Special  caution  is  needed  in  interpreting  the  relations  between 
the  instructional  variables  and  child  behaviors  discussed  in  this  sec- 
tion.    The  two  sets  of  data  were  obtained  from  classroom  observations, 
but  on  separate  days.     However,  some  correlations  may  be  due  to  the  in- 
terdependence of  the  variables.     For  example,  the  child  independence 
rate  may  be  lower  in  situations  where  the  instructional  process  requires 
frequent  intervention  by  adults.     Such  program  differences  will  most  cer- 
tainly affect  the  occurrence  of  the  child  behavior.     The  optimal  proce- 
dure to  obtain  measures  of  these  child  behaviors  would  be  in  standard- 
ized situations  where  the  children  would  have  equal  opportunities  to 
demonstrate  the  abilities.     However,  given  the  importance  of  these  child 
behaviors  and  the  absence  of  standardized  measures,  it  was  decided  that 
it  would  be  better  to  use  the  measures  that  could  be  obtained  from  t'le 
classroom  observation  data  than  to  ignore  these  variables.    The  results 
may  be  viewed  as  a  source  of  hypotheses  for  future  studies  that  focus 
on  the  child  behaviors  evaluated  in  this  section. 


a.      Independent  Children 

1 )      First  Grade  Findings 

The  variable  "independent  children"  in  our  study  is 
defined  as  a  child  or  a  group  of  children  engaged  in  any  task  without 
an  adult*    Table  104  provides  the  means  and  standardized  deviations  for 
each  sponsor  and  Non-Foliow  Through,    This  type  of  independent  behavior 
was  more  likely  to  be  found  in  classrooms  that  allowed  children  to  se- 
lect their  own  seating  and  groups  for  part  of  the  time  (Var.  24);  where 
a  wide  variety  of  activities  were  available  (\ur.  82,  83);  where  there 
were  an  assortment  of  audiovisual  and  exploratory  materials  available 
(Var*  237,  238);  where  adults  provided  individual  attention  (Var.  104), 
and  were  responsive  to  children  (Var.  365a);  and  where  adults  made 
friendly  comments  to  the  children  (Var.  389),  as  shown  in  Table   103.  In 
those  classrooms  where  textbookr  and  workbooks  were  used  more  frequently 


Question  asking,  verbal  initiative,  and  self-esteem  were  analyzed  for 
first  grade  only  since  too  few  significant  correlations  were  obtained 
in  third  grade. 
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than  in  other  observed  classrooms  (Var.  240),  children  were  not  as  often 
found  to  be  operating  independently.    Adults  who  asked  more  direct  ques- 
tions regarding  the  subject  matter  (Var,  451a)  were  not  as  likely  to 
have  independent  children.     In  classrooms  where  adults  praised  children 
frequently  (Var.  398a  describes  praise  in  general,  not  praise  for  specific 
tasks  or  achievement),  the  children  on  the  average  were  independent  less 
often.     (The  negative  relationship,  -.60,  was  substantial.) 

2)      Third  Grade  Findings 

As  in  first  grade,  children  in  third  grade  were  more 
independent  in  classrooms  where  they  were  allowed  to  select  their  own 
seating  and  groups  part  of  the  time  (Var.  24),  engaged  in  a  wide  variety 
of  activities  during  the  day  (Var.  83),  had  the  use  of  audiovisual  equip- 
ment (Var.  237),  and  received  individualized  attention  from  the  adults 
(Var.  104  and  375a)  and  where  adults  responded  to  their  questions  (Var. 
364  and  365).    Classrooms  where  adults  asked  thought-provoking  questions 
which  required  children  to  express  an  idea  (Var.  452a)  also  showed  more 
independent  child  behavior.    However,  in  classrooms  where  adults  more 
often  asked  direct  questions,  and  children  were  expected  to  respond  with 
known  answers,  children  displayed  less  independent  behavior  (Var.  451). 
This  finding  was  true  for  both  grade  levels. 

Although  the  correlation  between  praise  and  indepen- 
dence was  negative  at  the  third  grade  level,  it  was  not  as  strong  as  in 
the  first  grade.     There  was,  however,  a  strong  negative  relationship  in 
the  third  grade  between  adults  acknowledging  children  and  child  indepen- 
dence*    Acknowledgment  and  praise  are  very  similar  variables  and  seem  to 
have  similar  relationships  in  the  two  grade  levels. 

These  findings  appear  to  support  John  Holt's  descrip- 
tion in  How  Children  Fail  of  the  child  who  is  dependent  upon  a  teacher's 
praise.    Holt  says  such  a  child  is  a  "teacher  watcher."    He  has  his  ear 
pitched  to  hear  what  the  teacher  wants  rather  than  behaving  independently 
in  relation  to  his  own  thoughts  or  tasks.    This  suggests  that  if  teachers 
want  to  help  children  become  independent  in  working  on  tasks,  they  should 
use  praise  sparingly  and  specifically;  i.e.,  they  should  help  the  child 
find  r(       1  in  the  work  itself  rather  than  in  their  adult  approval.  Of 
course      e  do  not  know  whether  the  children  in  this  study  might  be  more 
indepei  if  they  were  given  the  opportunity.     It  can  be  noted  on 

Table  I       chat  University  of  Oregon  and  University  of  Kansas,  which  are 
more  structured  models  and  use  a  high  rate  of  praise,  were  below  the 
mean  of  other  sponsors  and  of  Non-Follow  Through  on  this  measure  of  in- 
dependence.   All  of  the  other  more  open  models  except  High/Scope  in  first 
grade  are  above  the  Non-Follow  Through  mean.    Both  Far  West  and  EDC, 
when  compared  to  Non-Follow  Through,  had  especially  high  means  in  both 
first  and  third  grades  for  independence. 
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b.      Task  Persistence 


1)  First  Grade 

The  next  dimension  to  be  considered  is  task  persis- 
tence.    For  this  study  **task  persistence"  is  defined  as  a  child  engaged 
in  self-instruction  over  a  designated  period  of  time  (a  matter  of  five 
interaction  frames).     If  during  the  task,  a  child  became  engageu  in  a  con- 
versation with  someone  else,  task  persistence  was  no  longer  coded;  in- 
stead, his  conversation  was  coded.    The  highest  positive  relationships 
indicate  that  task  persistence  occurred  most  often  when  textbooks  and 
workbooks  were  used  in  the  classroom  (Var,  240),     Since  working  with 
textbooks  and  workbooks  most  often  requires  children  to  be  silent  and 
solitary,  and  since  most  assignments  in  textbooks  and  workbooks  require 
a  period  of  self-instruction,  this  finding  dovetails  with  the  definition 
of  "task  persistence"  as  stated  above.    When  adults  instructed  one  child 
at  a  time  (Var,  375a),  the  children  were  also  more  likely  to  be  task 
persistent^    This  may  be  because  young  children  often  have  difficulty 
u  derstanding  group  instructions  or  perhaps  can't  get  the  teacher's  at- 
t  ntion.     Thus,  when  adults  instruct  on  a  one-to-one  basis,  children  are 
more  likely  to  have  a  question  answered  or  directions  clarified,  and 
therefore  have  the  information  necessary  to  be  persistent  at  their  tasks. 

2)  Third  Grade 

Children  were  more  task  persistent  in  classrooms 
where  textbooks  were  used  (Var,  240),  in  third  grade  classrooms  as  well 
as  in  first.     If  teachers  responded  to  a  child's  questions  about  subject 
matter,  offered  acknowledgment  for  a  task,  or  made  a  task-related  com- 
ment (Var,  364a,  394a,  390a),  the  children  w^^e  more  likely  to  be  task 
persistent.     Less  task  persiste'-xe  occurred  where  there  was  more  use  of 
audiovisual  equipment  and  exploratory  materials,  and  where  a  wide  variety 
of  activities  occurred  (Var,  38,  238,  83),    All  of  these  activities  were 
likely  to  encourage  conversation,  which  would  end  the  coding  of  task  per- 
sistence, as  it  is  defined  for  this  study.    Also,  teachers  who  more  often 
asked  academic  questions,  and  praised  children  or  interacted  with  them  on 
a  one-to-one  basis  (Var.  451a,  398a,  104),  were  not  likely  to  have  chil- 
dren who  show  a  high  rate  of  task  persistence.''^ 

However,  Table  104  indicates  that  these  findings  in 
third  grade  cannot  be  generalized  to  a  model.     The  University  of  Kansas 
model  uses  a  high  rate  of  praise;  their  teachers  are  likely  to  interact 
with  one  child  at  a  time,  and  their  mean  was  higher  than  all  other  spon- 
sors and  Non-Follow  Through  for  task  persistence  in  both  grade  levels. 
The  University  of  Kansas  does  prescribe  the  use  of  desk  work  where  text 
and  workbooks  are  used,  and  this  variable  was  positively  correlated  with 
task  persistence  in  both  grade  levels.     The  findings  indicate  that  the 
variable  is  probably  not  independent;  task  persistence  cannot  be  coded 


'^Any  conversation  stops  che  coding  of  this  nonverbal  behav/ior. 
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at  thj  same  time  a  structured  academic  interaction  is  occurring.  How- 
ever, in  the  teacher-focused  observations,  University  of  Kansas  teachers 
were  observed  to  be  highly  interactive  with  children  in  structured  aca- 
demic activities;  on  child-focused  observations,  children  were  observed 
to  be  highly  task  persistent.     Thus,  it  depends  upon  who  was  the  focus 
of  observation,  as  both  phenomena  probably  occurred  simultaneously. 


c.  Cooperation 

1)      First  Grade 

For  the  purposes  of  this  study,  ''cooperation"  is 
defined  as  two  or  more  children  working  together  on  any  joint  task  with- 
out an  adult.     Our  findings  indicate  that  this  kind  of  cooperation  was 
more  likely  to  be  found  in  situations  where  there  were  a  wide  variety  of 
activities  occurring  throughout  the  day  (Var.  83);  where  there  were  ex- 
ploratory materials  available  (Var,  238);  and  where  children  were  able 
to  choose  their  own  group  (Var.  24),     In  classrooms  where  the  adults 
interacted  with  two  children  (Var,  439a),  making  coiranents  about  the  task 
(Var,  390a)  and  responding  to  their  questions  (Var,  365a),  me  children 
seemed  more  often  to  join  each  other  in  cooperative  tasks.    When  text- 
books and  workbooks  (which  are  solitary  tasks)  were  used  a  great  deal 
(Var,  240),  the  children  were  not  likely  to  cooperate,  as  shown  by  a 
strong  negative  correlation  of  -,49,     Also  in  classrooms  where  adults 
asked  direct  questions  about  subject  matter  (Var,  451c),  a  negative  cor- 
relation with  cooperation  was  indicated. 


2)      Third  Grade 

Classrooms  in  which  children  worked  more  often  to- 
gether cooperatively  were  those  in  which  children  selected  their  own 
seating  and  groups  for  part  of  the  time  (Var,  24);  were  offered  a  wide 
variety  of  accivities  during  the  day  (Var,  83);  and  had  a  variety  of 
materials  available  for  their  use  (Var,  38,  45,  238),    These  materials 
included  exploratory  materials  and  audiovisual  equipment.    Variables  24, 
83,  and  238  were  also  significantly  correlated  at  the  first  grade  level. 
Given  the  opportunity  to  select  from  a  variety  of  both  activities  and 
materials,  children  apparently  chose  more  often  to  work  together  at  tasks 
than  they  did  in  classrooms  where  such  a  selection  was  not  offered.  While 
a  variety  of  materials  were  correlated  with  cooperative  behavior,  texts 
and  workbooks  in  academic  subjects  showed  a  high  negative  correlation 
with  child  v,ooperation.     When  children  worked  with  workbooks  (Var,  240), 
they  were  more  likely  to  work  alone  and  therefore  to  have  less  opportun- 
ity to  work  with  other  children  on  a  common  task.     This  finding  was  sig- 
nificant for  both  first  and  third  grades. 

The  data  indicated  that  a  negative  correlation  exists 
between  child  cooperation  and  adult  instruction  variables  which  describe 
adults  asking  children  direct  questions  about  subject  matter  and  then 
acknowledging  their  responses  (Var,  394a,  451a),     Variable  451a  was  sig- 
nificant for  the  first  grade  as  well.    On  the  other  hand,  adults  who 
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more  often  interacted  on  a  one-to-one  basis  with  children,  asked  thought- 
provoking  questions,  and  interacted  with  children  by  making  task-related 
comments  (Var.  104,  390a,  452a)  were  more  likely  to  have  children  who 
cooperated.     Importantly,  Variable  390a  (Adult  task-related  comments  to 
childrer.)  also  was  positively  correlated  with  child  cooperation  at  the 
first  grade  level.     A  correlation  was  shown  between  children  cooperating 
and  adults  responding  to  children  in  nonacademic  situations  (Var.  365a) 
at  both  first  and  third  grade  levels.     Apparently  children  need  adults 
to  respond  to  their  questions  as  they  engage  in  cooperative  tasks. 

The  variables  that  were  positively  correlated  with 
cooperation  are  also  chose  that  describe  the  more  open  models  which, 
in  their  stated  g'^als,  encourage  child-initiated  activities  and  cooper- 
ation among  children.     Data  in  Table  104  indicate  that  all  of  the  five 
more  open  models  had  means  higher  than  Non-Follow  Through  in  the  first 
grade.    Only  Far  West  and  Bank  Street  had  means  higher  than  Non-Follow 
Through  in  the  third  grade.     It  must  be  further  noted  that  those  vari- 
ables describing  in  part  the  more  structured  classrooms  of  University 
of  Oregon  and  University  of  Kansas  had  negative  correlations  with  the 
SRI-defined  child  behaviors  of  cooperation,  and  the  means  of  these  two 
sponsors  were  lower  than  those  of  all  other  sponsors  and  Non-Follow 
Through  in  both  first  and  third  grades.     The  implication  here  is  that 
children  are  likely  to  work  together  more  often  on  joint  projects  without 
adults  in  the  open  or  flexible  models  than  in  the  more  structured  models. 


d.      Verbal  Initiative 

1)      First  Grade 

For  the  purposes  of  this  report,  verbal  initiative 
was  recorded  whenever  a  child  asked  questions,  instructed  someone  else, 
engaged  in  a  task-related  conversation,  made  general  comments,  or  pro- 
vided feedback  to  other  children.    Children  demonstrated  more  verbal 
initiative  in  classrooms  where  a  wide  variety  of  activities  occurred 
(Var.  82,  83).     This  kind  oj.  environment  usually  allows  children  to  in- 
teract more  freely — that  is,  to  talk  and  work  together.     In  classrooms 
where  adults  engaged  in  more  general  conversation  and  were  responsive  to 
children's  questions  (Var.  389a,  365a),  children  also  showed  more  verbal 
initiative.     The  reader  is  reminded  that  these  are  two  separate  sets  of 
data,  and  the  findings  are  not  as  circular  as  they  seem  since  the  vari- 
ables relating  to  children's  questions  and  those  of  adult  responses  were 
collected  on  separate  days.     Understandably,  in  classrooms  where  instruc- 
tional materials  were  used  often  (Var.  28),  children  were  less  likely  to 
take  verbiil  initiative;  i.e.,  children  would  be  engaged  with  materials 
rather  than  with  each  other.    Another  variable  of  interest  which  suggests 
a  trend  bat  does  not  reach  significance  by  our  standards  is  adults  prais- 
ing children  (Var.  398a).    The  correlation  was  -.17  with  p  <  .10.  How- 
ever, the  possibility  is  raised  that  in  classrooms  where  a^lults  used  a 
high  rate  of  praise  the  children  were  less  likely  to  show  verbal  initi- 
ative. 
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2)      Third  Grade 


Classroom  environments  where  children  selected  their 
ow\\  seating  or  work  group  part  of  the  time  and  had  a  wide  range  of  re- 
source materials,  particiarly  audiovisual  equipment  (Var,  24,  38,  237), 
had  children  who  show  more  verbal  initiative.     This  type  of  environment 
evidently  permits  more  interaction,  such  as  questioning  or  commenting* 
In  classrooms  where  textbooks  and  workbooks  uere  more  frequently  used, 
the  cnildren  demonstrated  less  verbal  initiative  (Var,  240) •  Working 
with  standard  texts  and  workbooks  is  a  more  solitary  and  silent  activ- 
ity which  is  not  as  likely  to  give  children  the  opportunity  for  verbal 
initiative. 

Adults  who  offered  individualized  ar  ention  (Var*  104, 
375a),  were  responsive  to  children  in  a  nonacademic  situation  (Var.  365a); 
and  made  general  comments  (Var*  389a)  were  more  likely  to  have  children 
who  showed  verbal  initiative*    Variable  365a,   (Adult  responses  to  child 
re<^  lests  or  questions,  nonacademic)  had  a  high  correlation  with  child 
ini  lative  both  at  the  first  and  third  grade  levels.    However,  children 
were  less  likely  to  show  verbal  initiative  in  classrooms  where  adults 
asked  a  higher  rate  of  direct  questions  about  subject  matter  (Var,  451a), 
This  kind  of  interaction  makes  the  adult  the  *'ini tiator**  and  the  child 
the  "responder 

The  variables  positively  related  to  verbal  initia- 
tive were  those  which  described  the  more  open  classrooms*     In  both  grade 
levels  all  >  A^'e  of  the  more  open  models  had  means  higher  than  Non-Follow 
Through  and  the  two  more  structured  models, 

e.      Observed  Self-Esteem 

Cind  self-esteem,  for  the  purpose     of  this  study,  is  op- 
erational v  defi     .  as  existing  where  a  child  offers  his  opinion — he  may 
piaise  or  acknowlt.a/;e  tlie  \;ork  of  another  child.    This  child  also  makes 
statements  about  his  self-worth  and  extends  his  response  when  asked  ques- 
tions.    These  are  all  v'erbal  expressions  of  self-esteem.    The  authors 
have  hypothesized  that  a  child  might  feel  reasonably  good  about  himself 
if  he  -naae  such  statements,     (Even  though  this  is  a  limited  definition 
of  self-esteem,  the  authors  feel  it  is  important  to  make  an  effort  to 
develop  such  a  variable,  since  paper  and  pencil  tests  and  other  assess- 
ments of  self-esteem  are  also  quite  limited, )''« 

Our  data  suggested  that  more  self-esteem  was  evident  in 
classrooDS  where  children  took  part  in  a  wide  variety  of  activities  (Var, 


^OkI".  first  grade  ^^ata  are  presented  here  since  there  were  too  tew  cor- 
relations of  n'^te  the  third  grade  data  to  warrant  interpretation  in 
this  report, 
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81)  and  used  exploratory  materials  in  academic  subjects  (Var.  238).  Both 
of  these  variables  described  situations  that  allowed  children  to  explore 
and  possibly  to  make  statements  about  being  able  to  manage  equipment  them- 
selves or  to  praise  or  acknowledge  each  other's  accomplishments.  Adults 
who  asked  children  quebtions  (Var.  451a)  or  addressed  them  in  '^.all  groups 
(Var.  440a)  were  more  likely  to  have  children  who  expressed  sej.  -esteem. 
Perhaps  in  these  small  groups  the  children  had  opportunities  to  -xtend 
their  responses  to  questions  and  to  express  their  self-wurth.     Two  strange 
findings  are  that  children  were  less  likely  to  express  self-esteem  when 
adults  spoke  co  one  child  at  a  time  (Var.  438a)  or  when  children  were  ac- 
knowledged (Var.  39^ia).     Self-esteem,  as  the  varxable  is  defined  here,  re- 
quired children  to  make  specific  statements  which  apparently  were  more 
likely  to  occur  in  a  small  group  or  with  other  children  rather  than  on  a 
one-to-one  basis  with  an  adult.     Acknowledging  children,  telling  them 
their  behavior  or  products  were  acceptable  (Var.  394a)  which  might  be  ex- 
pected to  enhance  a  child's  attitude  toward  himself,  was  adversely  related 
to  a  child's  statement  of  self-esteem. 

The  variables  which  positively  related  to  self-esteem  de- 
scribed a  mixture  of  the  open  and  structured  classrooms.    And,  in  both 
first  and  third  grades,  the  two  highest  means  were  those  of  University 
of  Oregon,  a  structured  model,  and  University  of  Arizona,  a  more  open 
model . 


f .      Question  Asking 

Educators  have  long  recognized  the  value  of  a  child's 
asking  questions  as  a  primary  means  to  gain  information.     Previous  re- 
search indicates  that  question-asking  is  positively  related  to  test 
scores.       In  the  present  study  we  found  that  first  grade  children  asked 
more  questions  where  there  was  a  one-to-one  relationship  of  adults  with 
children  in  classrooms  (Var.  438a),  where  adults  responded  to  children's 
questions:   (Var.  364a,  365a),  and  where  adults  made  general  conversational 
comments  to  children  (Var.  389a)  ^     ChildrFr  ri^;kpd  fpwer  questions  where 
adults  focused  their  communication  towarr   a  small  group  (Var.  440a). '^''^ 

The  largest  correlation  of  a  process  variable  and  cnild 
question  asking  was  with  "Adult  communication  focus — one  child."  It 
should  be  remembered  that  in  the  University  of  Kansas,  as  well  as  several 
of  the  more  open  models,  th^  adults  focus  their  communication  toward  an 


^Previous  SRI  observational  studies  (Stallings,  Baker,  and  Steinmetz, 
1972,  and  Stallings,  1973)  report  a  significant  relationship  between 
children  asking  questions  and  .scores  on  achievement  tests  and  atti^ 
tudinal  tesus. 

>v*xhird  grade  data  are  not  interpreted  here  because  there  were  too  few 
significant  correlations  to  warrant  analysis. 
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individual  child.     The  data  on  Table  104  indicate  that  University  of  Kansas 
was  second  only  to  High/Scope  in  child  question-asking  in  the  first  grade. 
These  models  differ  greatly  in  their  theoretical  approach  in  regard  to 
use  of  materials,  classroom  activities,  structure,  and  control  systems. 
THus,  it  seems  that  the  question-asking  behavior  of  children  is  more  re- 
lated to  individualized  communication  patterns  than  it  is  to  other  com- 
ponents of  the  educational  models. 


3,      Relationships  Between  Days  Absent  and 
Instructional  Process  Variables 


Days  absent  is  an  important  outcome  variable  for  seveidl  rea- 
sons; i.e.,  many  school  budgets  are  determined  by  the  average  daily  at- 
tendance.   Also,  days  absent  can  be  used  as  an  indicator  of  attitude 
toward  school.     It  is  well  kno\^m  to  parents  and  teachers  that  if  a  child 
enjoys  school,  he  may  attend  even  if  he  does  not  feel  well.     If  he  does 
not  enjoy  school,  he  may  be  more  likely  to  be  absent  whenever  he  feels 
any  discomfort.    The  data  presented  here  represent  only  days  absent  with- 
out a  cjntrol  for  the  length  of  the  school  year. 

Correlations  were  computed  for  classroom  means  of  the  number 
of  days  absent  and  340  selected  instructional  variables,  first  adjust- 
ing for  the  baseline  I-JKAT  score.     (As  stated  previously,  approximately 
17  significant  correlations  could  have  occurred  by  chance.)     Table  1^0 
shows  the  correlations  that  were  significant  (p  <  .05  to  p  <  ,001)  for 
either  the  108  first  grade  or  the  58  third  grade  classrooms,    A  positive 
correlation  between  an  instructional  variable  and  days  absent  means  that 
children  were  absent  more  often  in  classrooms  where  that  instructional 
process  occurred,    A  negative  correlation  between  an  instructional  vari- 
able and  days  absent  means  that  children  were  absent  less  often  in  class- 
rooms where  that  process  occurred.     There  is  no  way  to  determine  whether 
these  are  causal  relations,  but  they  are  suggestive  for  further  investi- 
gation. 


a.      First  Grade  Classrooms 

Materials  used  in  the  classroom  were  recorded  on  the  PEI 
and  CCL,     Two  very  similar  variables  recording  the  use  of  audiovisual 
equipment  (Var,  38  -^nd  237)  showed  a  negative  correlation  with  absentee- 
ism (see  Table  105),    Apparently,  first  grade  classrooms  in  which  audio- 
visual equipment  is  used  as  an  instructional  aid  experience  less  absen- 
teeism than  those  classrooms  in  which  audiovisual  equipment  is  less  fre- 
quently used. 

Activities  of  the  classroom  personnel  and  grouping  arrange- 
ments of  children  were  related  to  the  rate  of  pupil  absenteeism  in  the 
first  grade.     The  variables  indicating  that  the  teacher  or  aide  was  en- 
gaged in  a  task  without  children  (Var.  85,  103,  108,  and  231)  showed  a 
positive  correlation  witn  days  absent.    Thus,  in  classrooms  where  the 
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TaM<  105 


PARTIAL  CORRELATION  OF  DAYS  ABSENT  WITH  INSTRUCTIONAL  VARIABLES 
108  FIRST  GRADES  AND  58  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


No. 


Variables 


Name 


First 
Grade 


Third 
Grade 


MATERIALS 

38      Audio  visual  equipment  used  ^.19  .05  -.06 

237      Audio  visual  equipment /Academic  Activities  -.22  .05  -.09 

241      Puzzles,  games/Academic  Activities  -.08  -.32  .05 

ACTIVITIES 


70  Sewing,  cooking,  pounding  -.11 

245  Story,  music,  dancing/Longitudinal  -.04 

252  Sewing ,  cooking ,  pounding /Longitudinal  - . 11 

256  Practical  skills  acquisition/Longitudinal  .16 


,32 
,28 
,28 
,26 


.05 
.05 
.05 
.05 


TIME  SPENT  AND  ACADEMIC  INTERACTION 


140  Total  weight  in  math  groupings  .11 
163  Total  weight  in  reading  groups  .18 
228      Total  weight  in  arts,  crafts  groupings  .04 


.32  .05 
.32  .05 
.38  .01 


GROUPINGS 


rtdults  in  the  Classroom 


108      Overall  occurrences  of  adults  without 

children  .22     .05  .08 

262      Average  number  of  adults  in  the  classroom/ 

Longitudinal  .26     .01  .09 


Adults  Without  Children 

85      Teacher  without  children  .25 

103      Adult  without  children  .22 

229      Teacher  involved/Classroom  Management  .03 

231      Volunteer  involved/Classroom  Management  .29 

I'ldividualized  Attention 


.01 
.05 

.01 


.20 
.08 
.27 
.36 


.05 
.01 


86      Teacher  with  one  child 
104      Adult  with  one  child 
109      One  child  with  any  adult 


.29 

,36 
,35 


.01 

.001 
.001 


.16 
19 
21 
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Table  105  (Continued) 


PARTIAL  CORRELATION  OF  DAYS  ABSENT  WITH  INSTRUCTIONAL  VARIABLES 
108  FIRST  GRADES  AND  58  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


First  Third 

Vaiiables  Grade  Grade 


No. 

Nane 

P^ 

L 

Individualized  Attention  (Continued) 

124 

One  child  with  aide/Math 

-.23 

.05 

-.20 

132 

One  child  with  any  adults/Math 

-  99 

— ,  ID 

143 

One  child  with  teacher /Reading 

m 

—  99 

155 

One  child  with  any  adults/Reading 

nm 

99 

164 

Personalized  instruction  in  reading 

-.34 

.001 

-.24 

257 

Teacher  with  one  child,  academic 

activities/Longitudinal 

-.23 

.05 

-.12 

259 

Volunteer  with  one  child,  academic 

activities /Longitudinal 

-.22 

.05 

-.10 

261 

Any  adult  with  one  child,  any  activity/ 

Longitudinal 

-.  31 

.01 

-.15 

421a 

Adults  attentive  to  individual  children 

-.26 

.01 

-.12 

Adults  with  Two  Children 

121 

Two  children  with  teacher/Math 

.00 

-.29 

125 

Two  children  with  aide/Math 

.01 

.35 

144 

Twu  children  with  teacher /Reading 

-.19 

.05 

-.19 

156 

Two  children  with  any  adults/Reading 

-.  20 

.05 

-.2' 

Adults  with  Small  Group 

122 

Small  group  with  teacher/Math 

-.07 

-.34 

Adults  with  Large  Group 

39 

Teacher  with  large  group 

.06 

.33 

.05 

95 

Aide  with  large  group 

.31 

.01 

.40 

.01 

112 

Large  group  oC  children  with  any  adult 

.23 

.05 

.47 

.001 

123 

Large  group  with  teacher/Math 

.11 

.44 

.001 

127 

Large  group  with  aide/Math 

.30 

.01 

.18 

135 

Large  group  with  any  adults/Math 

.29 

.01 

.52 

.001 

146 

Large  group  with  teacher/Reading 

.  12 

.33 

.01 

158 

Large  group  with  any  r.dults/Reading 

.25 

.01 

.44 

.001 

independent  Children 

114  One  child  independent  -.27     .01  -.25 

115  Two  children  independent  -.23     .05  -.20 
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Table  105  (Continued) 


PARTIAL  CORRELATION  OF  DAYS  ABSENT  WITH  INSTRUCTIONAL  VARIABLES 
108  FIRST  GRADES  AND  58  THIRD  GRADES 
(Follow  Through  and  Non-Fo31ow  Through) 


First 

Third 

Variables 

Grade 

Grade 

No. 

Name 

r 

P< 

r 

Independent  Children  (Continued) 

118 

All  children  independent 

-.  17 

- 

.  36 

01 

136 

One  child  independent /Math 

o  o 
- .  ZZ 

05 

— 

.  29 

05 

137 

Two  children  independent/Math 

-.03 

— 

.  26  . 

05 

138 

Small  group  of  children  independent/Math 

-.09 

— 

.41  . 

01 

142 

All  children  independent/Math 

-.18 

— 

.48  . 

OOJ 

159 

One  child  independent/Reading 

-.33  . 

001 

- 

.27  . 

05 

160 

Two  children  independent/Reading 

-.27 

01 

- 

.  21 

165 

All  children  independent/Reading 

-.14 

- 

.31  . 

05 

204 

Two  children  independent/Science 

.20  . 

05 

— 

.16 

INTERACTIONS 

Child 

Questioning 

346a 

Child  commands,  requests,  and  direct 

questions ,  nonacademic 

-.26 

01 

— 

.  03 

347a 

Child  commands,  requests,  and  direct 

questions ,  academic 

-.26 

01 

— 

.  12 

348a 

Child  open-ended  questions,  nonacademic 

.  i  / 

— 

0  1 

.  Jl 

05 

350a 

Child  questions  to  adults 

-.32  . 

001 

— 

.15 

450a 

All  child  open-ended  questions 

.14 

.32  . 

01 

478a 

Child  commands,  requests,  and  direct 

questions ,  academic 

-.05 

.32  . 

05 

Adult 

Questioning 

351a 

Adult  commands    requests,  and  direct 

questions  to  group  of  children,  non- 

academic 

-.04 

.30  . 

05 

353a 

Adult  commands,  requests,  and  direct 

questions  to  groups  of  children,  academic 

.20  . 

05 

.25 

355a 

Adult  open-ended  questions  to  children, 

nonacademic 

.00 

.28  . 

05 

452a 

Adult  open-ended  questions  to  children 

-.05 

.36  . 

01 

249 


(Continued) 

PARTIAL  CORRELATION  OF  DAYS  ABSENT  WITH   INSTRUCTIONAL  VARIABLES 
108  FIRST  GRADES  AND  58  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


First  Third 

Variables  Grade  Grade 


r  .... 

Ph  1  1  H 

^yll  J.  J.  (J 

mmm^nrt     rPOllPS^     nr  H^rp^^  Questions 

.22 

.05 

.  25 

JO  Oa 

v>njLJ.U    L  copoilb  CO    LO    aQUJ.L    U    cU"^  c  UU  cU 

Ques  t  inns 

-.OA 

-.36 

.01 

J  /  J.cl 

PHtIH    pv^pnHpH    rpsnnnsp   tn  ndul t  ooen— 

ended  question 

-.16 

-.31 

.05 

585c 

Child's  extended  response  to  questions 

-.17 

-.34 

.01 

Adult 

Responsiveness 

A /-^  1 1 1  t*    r"pcr>r>ncpc    trs       Vri  IH    »"PniiPct*Q    n  t" 

rtCi  U  X  L      LCOjJUllOCO      LU     L.11XX(J      LCV^UCOLO     ^  L. 

questions ,  acaaeniic 

m 

•  U  X 

-.  10 

JoDa 

Aciuit  responses  co  cniia  requescb  or 

quest io ns ,  nonacad eniic 

ns 

-  1  ft 

.  X  u 

Jo  /  a 

Aduic  responas  co  cnxiu  quebcion  wicn 

direct  question 

—   9  9 

.  VD 

— .  Ul 

q_>  Ja 

Adult  response  co  cniia  s  quescion  wxtn 

a  question 

_  99 

AC 

—  .  KJ^ 

^y->a 

Aciuit  responses  co  cniia  requescs  or 

questions,  academic 

— .  U  / 

-  9A 
— .  ZO 

Adu  Ic 

r  eedbac  k 

4Uua 

Adul t  re^  nf orcement  with  token ,  behavior 

9  9 

.  UUl 

09 
—  .  UZ 

403a 

Adult  praise,  behavior 

.32 

.001 

.02 

405a 

All  adult  corrective  feedback  to  children 

.09 

.48 

.001 

409a 

Adult  negative  corrective  feedback. 

behavior 

.04 

.37 

.01 

410a 

Adult  positive  corrective  feedback,  otner 

task-related 

.13 

.40 

.01 

411a 

Adult  negative  corrective  feedback,  other 

task-related 

.07 

.36 

.01 

432a 

Adult  punishment  of  children 

.13 

.54 

.001 

447a 

Adult  neutral  corrective  feedback,  task- 

related 

.02 

.38 

.01 

448a 

Adult  neutral  corrective  feedback,  behavior 

.16 

.41 

.01 

458a 

All  adult  negative  corrective  feedback 

.05 

.51 

.001 

465a 

Adult  feedback  to  children  for  behavior 

.21 

.05 

.34 

.01 
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Table  105  (Continued) 


PARTIAI   CORRELATION  OF  DAYS  ABSENT  WITH  INSTRUCTIONAL  VARIABLES 


108  FIRST  GRADES  AND  58  THIRD 

GRADES 

(Follow  Through  and  Non-Follow 

Through) 

First 

Third 

Variables 

Grade 

Grade 

Name 

r 

P< 

r 

Aaui  L 

Feedback  (Continued) 

470a 

All  adult  neutral  corrective  feedback 

.09 

.38  . 

01 

567c 

Total  interactions,  behavior  control 

.20  . 

05 

.16 

578c 

Adult  neutral  corrective  feedback,  task- 

related 

.21  . 

05 

.41  . 

01 

579c 

Adult  neutral  corrective  feedback,  behavior  .25 

01 

.29  . 

05 

58gc 

All  adult  negative  corrective  feedback 

.14 

.32  . 

01 

596c 

Adult  feedback  to  children  for  behavior 

.25  . 

01 

.30  . 

05 

601c 

All  adult  neutral  corrective  ftsiback 

.19  . 

05 

.30  . 

05 

Instruction 

375a    Adult  instructs  an  individual  child 
Child  Attending 

416a    Children  attentive  to  adults,  nonacademic 
417a    Children  attentive  to  adults,  academic 
464a    Child  dttenLlve 


-.06 


.06 
.28 
.14 


01 


-.34  .01 


.35 
.45 
.29 


.01 

.001 

.05 


Conversational  Statements 

344a    Individual  child  verbal  interactions  with 

adult  -.17 
388a  Child  task-related  comments  to  adults  -.01 
516c    Social  interaction  among  children  .03 

Affect 

460a    All  child  positive  affect  -.20 

462a    All  positive  behavior  -.27 

463a    All  negative  behavior  .02 

Child  Behavior 


,05 
.01 


,29 
,28 
,4-^ 


.27 
,28 
.48 


.05 
.05 
.001 


.05 
.05 
.001 


573c    All  child  nonverbal 


,21  .05 


,07 
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Table  105  (Concluded) 


PARTIAL  CORRELATION  OF  DAYS  ABSENT  WITH  INSTRUCTIONAL  VARIABLES 
108  FIRST  GRADES  AND  58  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


Variables 


No, 


Name 


First 
Grade 


Third 
Grade 


Communication  Focus 

438a    Adult  communication  or  attention  focus, 

one  child  -.25     .01      -.28  .05 

441a    Adult  communication  or  attention  focus, 

large  groups  .15  .37  ♦Ol 

471a    Adults  attentive  to  large  group  .21     .05        .34  .01 

Miscellaneous 


Adult  movement 


30  .01 


.14 


teacher  or  aide  was  frequently  involved  in  activities  that  did  not  in- 
clude children,  such  as  grading  papers,  preparing  assignment  or  cleaning 
up,  the  children  were  absent  more  often*    Children  were  also  absent  more 
frequ'ently  from  classrooms  where  adults  worked  with  large  groups  of  chil- 
dren (Var.  95,  112,  127,  135,  158,  and  471a). 

On  the  other  hand,  individualized  attention  (Var.  86,  104, 
109,  124,  132,  143,  144,  155,  156,  160,  164,  421a,  and  438a)  appears  to 
be  an  important  factor  in  daily  attendance.    These  thirteen  variables  re- 
lating to  individualized  attention  and  absenteeism  can  be  found  on  Table 
105^    All  of  these  variables  indicating  individualized  attention  showe 
a  negative  correlation  with  days  absent  from  school.     The  four  highest 
correlations  were  Var.  104  (Adult  with  one  child),  Var.  109  (One  child 
with  any  adult);  Var.  155  (One  child  with  any  adult  in  reading);  and  Var. 
164  (Personalized  instruction  in  reading). 

Two  variables  which  recorded  the  number  of  adults  (Var. 
108  and  262)  in  the  classroom  showed  a  positive  correlation  with  number 
of  days  absent,  which  may  indicate  that  a  higher  adult-student  ratio  is 
only  one  aspect  to  be  considered  when  evaluating  the  effectiveness  of 
classroom  personnel.    What  the  adult  is  doing  may  be  more  important  thati 
sheer  number  of  adults.    Adults  who  were  less  involved  with  the  children 
or  who  worked  only  with  large  groups  were  likely  to  have  a  higher  absence 
rate  in  their  classrooms,  while  adults  who  interacted  with  children  on  a 
one-to-one  basis  had  a  lower  absentee  rate  among  their  children. 


252 


When  children  were  allowed  to  work  on  their  own  without 
adults  (Var.  114,  115,  136,  159,  and  160),  the  data  indicated  they  at- 
tend school  more  frequently.     These  variables  encompassed  an  overall  in- 
dependence rate  of  children  involved  in  tasks.     In  particular,  they  de- 
scribed one  or  two  children  working  independently  in  reading  or  math. 

In  a  classroom  atmosphere  where  children  asked  questions 
of  the  adults  (Var.  350a),  children  tended  to  be  absent  less  frequently. 
Three  variables  which  describe  child  questioning  (Var.  346a,  347a,  and 
350a)  were  negatively  correlated  with  absenteeism.     Also,  in  classrooms 
where  adults  responded  to  children's  questions  (Var.  364a  and  365a),  the 
children  were  absent  less  frequently.     Two  other  variables  which  reflect 
specific  types  of  adult  responses  to  the  questions  of  children  also  were 
related  to  children  being  present  more  often  in  school.    They  describe 
an  adult  responding  to  a  child's  question  with  another  question  (Var. 
367a,  453a).    All  of  the  preceding  variables  describe  situations  where 
adults  are  responsive  to  children,  which  suggests  that  adults  are  encour- 
aging i:he  children  to  think  by  asking  further  questions,  rather  than  just 
providing  an  answer. 

The  rate  of  absenteeism  tended  to  increase  in  situations 
where  children  observed  an  adult  in  an  academic  r.ctivity  (Var.  417a); 
i.e.,  the  children  were  not  actively  engaged  in  their  learning  but,  in- 
stead, were'  listening  and  observing.    Also,  classrooms  that  had  small 
groups  of  children  responding  in  chorus  to  adult  questions  during  aca- 
demic instruction  (Var.  363a)  showed  a  higher  absentee  rate.  This 
variable  suggests  a  lack  of  individualized  attention,  which  was  previ- 
ously identified  as  being  related  to  a  lower  absentee  rate. 

When  there  was  a  high  rate  of  adult  feedback  for  child 
behavior  in  a  classroom,  children  were  more  likely  to  be  absent.  This 
occurred  whether  the  feedback  was  praise  or  tokens  given  for  acceptable 
behavior  or  vhether  the  feedback  was  for  unacceptable  behavior,  with  cor- 
rection or  control  exerted  (Var.  400a,  403a,  465a,  567c,  579c,  and  596c). 

In  those  classrooms  where  more  positive  behavior  (de- 
fined as  smiling  or  laughing,  Var.  460a  and  462a)  was  evident,  there  was 
less  child  absence.     This  finding  replicates  previous  findings  (Stallings, 
Baker,  Steinmetz,  1972). 


b.      Third  Grade  Classrooms 

The  kind  of  materials  used  in  the  classroom,  which  was 
related  to  the  children's  rate  of  absenteeism,  changes  from  first  to 
third  grade.     In  third  grade  classrooms  where  puzzles  and  gdmes  (Var. 
241)  were  used  in  academic  activities,  the  children  were  absent  less 
(see  Table  ^05);  whereas  in  first  grade  classrooms,  lower  child  absentee- 
ism was  related  to  higher  use  of  audiovisual  equipment. 
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In  the  third  grade,  certain  classroom  activities  seemed 
to  be  associated  with  the  rate  of  absenteeism.     In  classrooms  where  chil- 
dren had  activities  that  allowed  for  sewing,  cooking,  carpentry,  stories, 
music,  dancing,  or  practical  skill  acquisition  (Var,  70,  245,  252,  and 
256),  the  children  were  absent  less  frequently.    Children  were  absent 
more  frequently  when  they  were  involved  in  reading  and  math  (Var,  140 
and  163)  for  a  higher  percentage  of  the  time. 

In  direct  opposition  to  the  first  grade  findings  regard- 
ing che  teacher  or  aide  without  children,  in  classrooms  where  the  third 
grade  teacher  was  more  often  involved  in  classroom  management  tasks  (Var, 
229),  the  children  were  in  school  more  often.    Third  grade  children  may 
have  less  need  of  the  teacher's  attention  and  may  be  more  independent 
than  first  grade  children;  so  that  when  the  teacher  engages  in  class- 
room management  tasks,  the  absence  rate  is  not  adversely  affected. 

Note:    As  in  the  first  grade,  if  the  third  grade  children 
spent  a  large  portion  of  the  school  day  in  la^'ge  groups  with  adults,  the 
absentee  rate  was  high.     Seven  variables  which  represented  children  in 
large  groups  with  adults  (Var,  89,  95,  112,  123,  135,  146,  and  158)  showed 
a  positive  correlation  with  the  absentee  rate.    These  were  not  limited, 
but  referred  to  large  group  activities  in  reading  and  math  and  all  ocher 
activities.     Two  FMO  interaction  variables  (Var.  441a  and  471a)  also  in- 
dicated that  when  adults  focused  their  attention  on  a  large  group,  chil- 
dren were  absent  more  frequently.     Variable  471a  was  also  significant 
for  first  grade  children.     Conversely,  when  children  received  individual- 
ized attention  (Var,  121,  344a,  375a,  and  438a),  they  tended  to  be  absent 
from  school  less  often.     Frequency  of  adult  attention  to  one  child  (Var, 
438a)  also  was  related  to  less  absenteeism  in  first  grade  classrooms. 

As  in  the  first  grade,  in  third  grade  classrooms  where 
children  were  more  independent  the  children  tended  to  be  absent  less 
often.    These  correlations  occurred  in  all  instances  of  children  oper- 
ating independently  in  activities  and  they  also  occurred  whether  the 
child  was  working  alone,  with  another  child,  or  in  a  small  group  in  math 
(Var,  118,  136,  137,  138,  142,  159,  and  165), 

Tiiird  grade  classrooms  where  children  asked  questions  (Var, 
348a,  450a,  and  478c)  and  where  adults  were  responsive  to  the  children 
(Var,  495c)  showed  a  lower  rate  of  absenteeism. 

In  classrooms  where  adults  asked  children  open-ended  ques- 
tions (Var,  355a,  452c)  children  were  absent  less  often.    This  finding  is 
further  emphasized  by  two  variables  which  relate  to  child  responses  to 
open-ended  questions:    when  children  responded  to  an  adult's  open-ended 
question  (Var,  368a)  or  gave  an  extended  response  to  any  type  of  ques- 
tion (Var.  371a,  and  585c),  the  rate  of  absenteeism  was  lov/er.  However, 
in  classrooms  where  adults  commanded  or  asked  direct  questions  of  groups 
of  children  in  nonacademic  activities  (Var,  351a),  children  were  absent 
more  often. 

In  classrooms  where  children  were  more  often  not  interacting 
but  were  listening  to  or  observing  adults  (Var.  416a,  417a,  464a)  ab- 
sentee rates  were  higher.    A  high  correlation  (.45)  with  absence  was 
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found  for  children  attentive  to  or  observing  adults  in  an  academic  ac- 
tivity (Var.  417a).    This  was  true  for  both  first  and  third  grade  class- 
rooms on  Var,  417a  where  the  children's  outwa  "d  behavior  was  passive, 
which  indicates  that  they  may  not  have  been  sufficiently  involved  in  the 
academic  activity. 

Variables  which  reflect  another  dimension  of  an  inter- 
active environment  indicated  that  when  the  conversation  was  task-related 
(Var*  388a),  the  children  were  absent  less  often.    However,  when  the  in- 
teraction was  purely  social  (Var,  516c),  the  children  were  more  likely 
to  be  absent,     (Social  interactions  included  all  of  the  general  comments 
children  make  among  themselves,  both  positive  and  negative;  these  were 
mainly  greetings,  personal  compliments  or  criticisms,) 

Consistent  with  some  of  the  first  grade  findings,  many 
types  of  adult  feedback  were  related  to  children's  absence  from  school. 
Not  surprisingly,  aault  punishment  of  children  (Var,  432a)  had  the  high- 
est correlation  of  ,54,     This  means  that  in  classrooms  where  children 
were  often  punished,  children  also  were  absent  more  often.    Another  high 
correlation  with  absenteeism  was  all  adult  negative  corrective  feedback 
(Var,  458a)  with  a  correlation  of  ,51,    There  are  a  total  of  15  feedback 
variables  that  showed  a  significant  correlation  with  absenteeism.     In  the 
first  grade,  the  feedback  variables  were  correlated  primarily  with  be- 
havior.    However,  in  the  third  grade,  the  feedback  variables  were  related 
to  nonacademic  task  activities  and  academic  activities  as  well  as  to  be- 
havior.    In  any  event,  whether  the  feedback  was  negative,  neutral,  or 
positive,  it  had  an  adverse  relationship  with  the  third  grade  children's 
school  attendance. 

The  correlations  of  the  variables  which  describe  feelings 
or  affect  were  similar  for  third  grade  and  first  grade.    Classrooms  with 
more  positive  behavior  (Var,  460a,  462a)  showed  a  lower  absence  rate. 
In  addition,  in  third  grade  classrooms  where  more  negative  behavior  (Var, 
463a)  was  observed,  the  children  were  absent  more  often. 


c.  Conclusions 

These  data  suggest  that  in  both  first  and  third  grade 
classrooms,  children  may  be  absent  less  frequently  in  classrooms  where 
there  is  a  higher  rate  of  child  independence,  child  questioning,  adults 
responding,  individualized  instruction,  and  open-ended  questioning. 
Also,  in  classrooms  where  children  and  adults  show  more  positive  affect 
(smiling  or  laughing)  the  children  may  be  absent  less  often. 

Children  were  absent  more  often  in  both  first  and  third 
grade  classrooms  where  they  worked  in  large  groups  more  often  and  where 
adults  used  direct  questions  in  academic  work  and  frequent  corrective 
feedback  more  often. 

Findings  for  the  third  grade  indicate  that  in  classrooms 
where  children  were  punished  more  often,  they  also  were  absent  more  often. 
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In  addition,  classrooms  with  a  higher  rate  of  negative  affect  on  the  part 
of  teachers  and  students  showed  a  higher  absence  rate, 

A  report  of  sponsor  absence  rate  by  grade  level  indicates 
that  at  the  first  grade  level,  those  sponsors  who  used  more  highly  struc- 
tured environments,  materials,  and  interactions  also  had  a  higher  ab- 
sence rate  (see  Table  106).     Two  sponsors.  Far  West  Labs  and  University 
of  Arizona,  who  used  a  wide  variety  of  activities  and  materials  and  have 
classrooms  where  children  exhibited  independent  behavior,  had  the  lowest 
absence  rate  of  all  sponsors  at  both  the  first  and  third  grade  levels, 
T  .e  data  on  Table  106  also  indicate  that  the  absence  rate  for  all  sponsors 
and  Non-Follow  Through  diminished  from  first  grade  to  third  grade,  !Vhile 
the  means  and  standard  deviations  of  Follow  Through  and  Non-Follow  Through 
were  very  similar.  Far  West's  and  University  of  Arizona's  absence  races 
were  considerably  lower  than  Non-Follow  Through  rates. 

Although  the  data  are  correlational  and  causal  effects 
cannot  be  attributed  to  the  instructional  processes,  the  correlations 
are  high  enough,  and  the  sample  large  enough,  to  suggest  some  directions 
for  further  research  in  absenteeism. 


Table  106 

MEANS  AND  STANDARD  DEVIATIONS  OF  DAYS  ABSENT 
FOR  SPONSORS  AND  NON-FOLLOW  THROUGH 


First  Grade^  Third  Grade"^ 

Standard  Standard 
Mean    Deviation      Mean  Deviation 


Far  West  Lab 

9.81 

1.80 

7.99 

1.40 

University  of  Arizona 

12.37 

4.34 

6.34 

0.78 

Bank  Street  College 

14.90 

6.41 

9.64 

6.42 

University  of  Oregon 

17.12 

3.72 

12.12 

1.63 

University  of  Kansas 

15.34 

16.70 

10.28 

2.77 

High/Scope 

13.36 

3.25 

EDC 

14.25 

10.90 

10. 5J 

7.46 

All  Follow  Through 

14.15 

6.33 

9.50 

4.30 

Non-Follow  Through 

14.05 

5.65 

9.59 

2.59 

Adjusted  scores. 
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4.      Relationships  Between  Scores  on  the  Raven's  and 


Instructional  Process  Variables 


Correlations  (adjusted  for  the  baseline  WRAT  scores)  were  com- 
puted using  340  instructional  variables  and  58  third  grade     * issroom  mean 
scores  on  the  Raven's  Coloured  Progressive  Matrices  (1965).    The  Raven's 
can  be  described  as  a  nonverbal  perceptual  problem-solving  test  in  which 
children  study  a  pattern  from  which  a  piece  is  missing,  and  then  select 
from  amons  several  alternatives  the  piece  that  correctly  completes  the 
pattern.    The  test  was  administered  in  a  group  and  some  of  the  original 
items  were  deleted  (see  Appendix  I  for  scoring  procedures). 

Third  grade  classrooms  in  which  children  scored  high  on  the 
Raven's  had  a  variety  of  activities  occurring  and  a  variety  of  materials 
available.    Activities  such  as  story  telling,  music,  sewing,  cooking, 
arts  and  crafts  (Var.  63,  64,  70,  83,  245,  246,  and  256)  were  among 
those  that  correlated  positively  with  the  Raven's  test  scores  (see  Table 
107).    Also  in  these  classrooms,  children  were  allowed  to  select  their 
own  seating  and  work  groups  while  they  engaged  in  those  activities  (Var. 
24)  and  audiovisual  equipment,  games,  toys,  and  exploratory  materials 
(Var.  25,  37,  40,  44,  45,  and  238)  were  available  to  them. 


Table  107 

PARTIAL  CORRELATIONS  OF  INSTRUCTIONAL  VARIABLES 
WITH  RAVEN'S  TEST  SCORES   (58  THIRD  GRADE  CLASSROOMS) 


Variables 

r 

No. 

Name 

MATERIALS 

25 

Games,  toys,  play  equipment  present  * 

.34 

.01 

37 

Audio  visual  equipment  present 

.28 

.05 

40 

General  equipment,  materials  used 

.26 

.05 

44 

Total  number    different  resource  categories  coded 

"present"  over  three  day? 

.34 

.01 

45 

Total  number  different  resource  categories  coded 

"used  today"  over  three  days 

.33 

.01 

238 

Exploratory  materials/Academic  activities 

.28 

.05 

240 

Texts,  workbooks/ Academic  activities 

-.37 

.01 
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Table  107  (Continued) 


IVRTIAL  CORRELAflONS  OF  INSTRUCTIONAL  VARIABLES 
WITH  RAVEN'S  IKST  SCORES  (,58  THIRD  GRADE  CLASSROOMS) 


Var  iabl es 

r 

P.  . 

No  . 

Name 

ACTIVITIES 

:^ 

Child  selection  of  seatirg  and  work  groups 

•  HO 

Dm 

63 

Story,  music,  dancing 

05 

bA 

Arts,  craf wS 

.  29 

.05 

D  / 

Reading ,  alphabet ,  language  development 

-.44 

.001 

70 

Sew'.ng,  cooking,  pounding 

.27 

.05 

83 

Wide  variety  of  activities,  over  one  day 

.35 

.01 

84 

Approximate  number  of  children  in  the  classroom 

in  any  -activity 

-.30 

.05 

243 

StCvty,  music,  dancing/ i^ongitudiial 

.33 

.01 

246 

Arts' ,  craf  ts  /  Longitudinal 

.36 

.01 

248 

Numbers,  math,  arith  » *tic/Longi tudinal 

-.40 

.01 

249 

Heading,  alphabet,  language  developraent/Long.  ::udi  ^al 

-.46 

.001 

256 

Practical  skills  acquisition/Longitudinal 

.31 

.05 

TIME 

SPENT  AND  ACACEMI'^  .^CERACTIOM 

242 

Percent  CCLs  in  which  an  acade.nic  activity  is 

occurring 

-.  31 

.0'' 

GROUPINGS 

Adults  in  the  Classroom 

96 

Overall  aide  occurrence 

-.46 

.001 

108 

Overal-  adult  occurrences 

-.30 

.05 

262 

Average  number  of  adults  in  the  classroom/ 

Longitudinal 

-  38 

.01 

Adulcs  Without  Children 


91      Aide  without,  children 
103      Adult  without  children 


.30 


.05 
.01 


individualized  Attention 


86  Teacher  with  one  child 

92  Aide  with  one  child 

104  Adult  with  one  child 

109  One  child  with  any  adult 

120  One  child  with  teacher/Math 

1  ^ii  One  rhild  with  aide/Math 


.34 
.34 
.35 
.32 
.27 
.29 


.01 
.01 
.01 

.0.: 

.05 
.05 
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Table  107  (Continued) 


PARTIAL  CORRELATIONS  OF  INSTRUCTIONAL  VARIABLES 
WITH  RAVEN'S  TEST  SCORES  (58  THIRD  GRADE  CLASSROOMS) 


 Variables  

No  ♦  Name  

Individualized  Attention  (Continued) 

143  One  caild  wiLh  teacher/Reading 

1A7  one  child  with  aide/Reading 

155  One  child  with  any  adult/Reading 
164  Personalized  instruction  in  reading 
257  Teacher  with  one  child,  academic  activities/ 

longitudinal 

261      Any  adult  with  one  child,  any  activity/Longitudinal 
Adults  with  Two  Children 

148  'l\jo  children  with  aide/Reading 

156  Two  children  with  any  aduits/Reading 
221      IVo  children  with  any  adults/Arts  and  Crafts 

Adults  with  Small  Group 

88  Teacher  with  small  group 

94  Aide  witn  small  group 

106  Adult  with  small  group 

111  Small  group  of  children  with  any  adulc 

126  Small  group  with  aide/Math 

134  Small  group  wich  any  adults/Math 

145  Small  group  with  teacher /Read ing 

149  Small  group  with  aide/Reading 

157  Small  group  with  any  adults/Reading 
420a  Adults  attentive  to  a  small  group 
440a  Adults  communication  or  attention  focus,  small  group  - 

Adults  with  Large  Group 

150  Large  group  with  aide/Reading 
In^^ependent  Chi?,dren 

114  One  child  independent 

115  Two  children  independent 

116  Small  group  of  children  independent 
118  All  children  independent 

\29      Large  group  of  children  independent/Math 
142      AW  children  independent /Math 

159  One  child  independent/Reading 

160  Two  children  independent/Reading 

185      Large  group  of  children  independent/Sociul  Studies 
260      Children  independent,  academic  activities/ 
Longitudinal 

259 


Table  107  (Continued) 


PARTIAL  CORRELATIONS  OF  INSTRUCTIONAL  VARIABLES 
WITH  RiWEN'S  TEST  SCORES  (58  THIRD  GRADE  CLASSROOMS) 


Variables 

r 

p. 

Name 

Miscellaneous 

113 

Overall  occurrence  of  children  with  any  adult 

-.42 

.01 

INTFRACTIONS 

Child 

Questioning 

3A6a 

Child  commands,  requests,  and  direct  questions, 

nonacademic 

.29 

.05 

3A8a 

Child  open-endea  questions,  nonacademic 

.33 

.01 

350a 

Child  questio:>s  to  adults 

.36 

.01 

450a 

All  child  open-ended  ques t* ions 

.  34 

.01 

477c 

Child  commands,  reauests,  and  direct  questions. 

nonacademic 

.29 

.05 

479c 

Child  open-ended  questions,  nonacademic 

.  33 

.01 

480c 

Child  open-ended  ques tions ,  academic 

.  29 

.05 

581c 

All  child  open-endca  questions 

.  31 

.05 

\dult 

Questioning 

354a 

Adult  commands,  requests,  or  direct  questions  to 

children 

-.47 

.001 

357a 

All  adult  questions  to  children 

-.39 

.01 

451a 

Adult  academic  commands,  requests,  or  direct  ques- 

tinns   ^n  rhilriT'pn 

-.41 

.01 

483c 

Adult  commaiids,  requests,  or  direct  questions  to 

individual  children,  nonacademic 

.33 

.01 

485c 

Adult  commands,  requests,  or  direct  questions  to 

Midividual  children,  academic 

-.27 

.05 

Child 

Responsiveness 

358a 

All  child  response 

-.38 

.01 

360a 

Child  responses,  academic 

-.42 

.01 

362a 

One  child  responds  to  adult  academic  commands,  re- 

quests, or  direct  questions 

-.49 

.001 

490c 

Child  responses,  nonacademic 

.34 

.01 

493c 

One  child  responds  to  adult  academic  commands,  re- 

quests, or  direct  questions 

-.36 

.01 

585c 

Child's  extended  response  to  questions 

.33 

.01 

Adult 

Responsiveness 

365a 

Adult  responses  to  child  requests  or  questions,  non- 

academic 

.43 

.001 

?.60 


Table  107  (Concluded) 


1>AR11AI,  c:ORRi:LAriONS  OF  INSTRICTIONAL  VARIABLES 

Willi  r.\vi:n^s  ti:st  scores  (58  third  gr^\de  classrooms) 


Variables 


Name 

r 

Adult 

Feedback 

394a 

All  adult  acknowledgment  to  children 

-.45 

.001 

395a 

Adult  acknowledgment  to  children,  academic 

-,4b 

.001 

398a 

All  adult  praise  to  children 

-.32 

.05 

399a 

Adult  re  inf orcement  with  token,  academic 

-.34 

.  01 

400a 

Adult  reinforcement  with  token,  behavior 

-.27 

.05 

40 1  a 

Adult  reinforcement  with  token,  other  task- 

related 

-.33 

.01 

40Ja 

Adult  praise,  academic 

-.34 

.  01 

40  3a 

\dult  praise,  behavior 

-.27 

.  05 

40oa 

Adult  positive  corrective  feedback,  academic 

-.42 

.01 

4i2a 

Adult  feedback  to  child  responses  to  adult 

academic 

commands,  requests,  or  direct  questions 

-.51 

.001 

4  57a 

All  adult  positive  corrective  feedback 

-.41 

.  01 

469a 

All  adult  reinforcement  with  tokens 

-.34 

.  01 

54  3.. 

Adult  feedback  to  child  responses  to  adult 

academi  c 

commands,  requests,  or  direct  questions 

no  1 

600c 

All  adulc  reinforcement  with  tokens 

-  .  J  J 

.  UJ 

Inst  rue  t  ion 

376a 

Adult  instructs  a  group 

.  JO 

.  j:) 

^'5  5a 

All  adult  instruction 

.29 

.  05 

386a 

All  adult  instruction 

.28 

.05 

Conver saLiona ^  Statements 

34  3a 

Child  to  adult,  all  verbal  except  response 

.  45 

.  001 

387a 

Child  general  comments  tj  adults 

.28 

.05 

388a 

Child  task-related  comments  to  adults 

.45 

.001 

39()a 

Adul t  task- related  comments  to  chi Idren 

.37 

.01 

;7Vc 

Child  to  adult,  all  verbal  except  response 

.30 

.05 

4  76c 

Verbal   interactions  among  children 

.  37 

.  01 

519c 

Child  task-related  comments  to  adults 

.27 

.05 

5:4c 

Child  corrective  feedback 

.42 

.  01 

Affect 

4b()a 

All  child  positive  affect 

.  36 

.01 

46Ja 

All  positive  behavior 

.46 

.001 

59^c 

All  child  negative  affect 

.27 

.05 

=>93c 

All  positive  behavior 

.43 

.001 

Child 

Behavi  or 

546c 

1]  d  wait  ing 

-.32 

.05 

598c 

C     Id  cooperation 

,30 

.05 
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While  engaged  in  this  variety  of  activities,  children  were 
most  likely  to  be  found  working  independently  or  receiving  individual- 
ized attention.     Variables  which  correlated  with  the  Raven's  test  scores 
describe  independent  children  in  a  variety  of  groupings.     Child  inde- 
pendence whether  in  large  groups,  small  groups,  or  a  two-child  group  or 
alone  (Var,  114,  115,  116,  118,  139,  142,  159,  160,  165,  185,  and  260) 
correlated  positively  with  the  Raven's  test  scores.    When  children  are 
working  without  the  assistance  of  an  adult,  they  may  have  more  opportun- 
ity to  think  independently  and  to  experience  the  problem-solving  type  of 
learning — which  may  result  in  higher  scores  on  such  tests  as  the  Raven's, 
The  adults  more  often  provided  individualized  attention  (Var,  86,  92, 
104,  109,  120,  124,  143,  147,  155,  164,  257,  and  261)  in  classrooms  where 
children  scored  high  on  the  Raven's,     Instances  of  adults  working  with 
two  children  (Var,  348,  156,  and  221)  also  were  positively  correlated  with 
the  Raven's  test  scores. 

Children  in  clasbrooms  where  the  Raven's  scores  are  higher  seemed 
to  ask  questions  more  frequently,  either  direct  open-ended  questions,  aca- 
demic or  nonacademic  (Var.  346a,  348a,  350a,  450a,  477c,  479c,  480c,  581c). 
The  important  dimension  is  that  children  were  asking  questions  of  adults 
in  the  classroom.     Questioning  and  inquiring  seem  to  be  important  steps 
in  the  problem-solving  process.     The  children  asked  their  questions  and 
the  adults  recognized  them  and  responded  (Var.  3&5a) . 

In  addition  to  questioning,  children  and  adults  also  experience 
other  types  of  verbal  interaction  (Var,  343a,  387a,  388a,  390a,  474c, 
519c)  which  were  related  to  the  high  Raven's  scores.     The  incidence  of 
child  task-r3lated  comments  to  adults  (Var,  388a)  had  a  high  positive 
correlation  (.45)  and  that  of  adult  task-related  ^-^mments  to  children 
also  had  a  significant  correlation.     The  childrr    in  these  classrooms 
also  interacted  with  each  other  (Var,  476c)  as  well  as  with  the  adults 
in  the  classroom.     Some  adult  structional  variables  (Var,  376a,  455a, 
586c)  were  also  positively  correlated. 

Classrooms  which  showed  high  test  scores  on  the  Raven's  also 
showed  high  occurrences  of  affective  behavior,  with  children  expressing 
both  positive  and  negative  types  of  behavior  (Var,  460a,  452a,  592c, 
and  593c) .  , 

When  children  are  working  independently  of  adults,  they  some- 
times cooperate  and  work  with  other  childrer  (Var,  598c)  on  a  common 
task,     3y  working  together,  children  may  learn  to  solve  problems  on  their 
own  J 

A  high  occurrence  of  reading  and  math  and  the  use  oi  text  and 
workbooks  (Var,  67,  240,  242,  248,  and  249)  were  negatively  correlated 
with  the  Raven's  test  scores.     Classrooms  v;nich  emphasized  reading  and 
Hc'th  skills  in  a  structured  academic  for^nat  and  used  standardized  text 
or  workbooks  may  not  have  allowed  enough  time  for  the  more  f le  lible  type 

activities  that  relate  to  success  on  the  Raven's  test.    At  least  it 
13  clear  that  the  instructionaJ  processes  that  correlated  positively 
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with  scores  on  the  MAT  test  are  different  from  the  processes  that  corre- 
lated with  the  Raven's  test  scores,*    Obviously,  the  two  tests  are  as- 
sessing very  different  skills  and  the  development  of  each  skill  requires 
different  treatments. 

When  adults  frequently  worked  with  children  in  either  small  or 
large  groups,  the  children  scored  lower  on  the  Raven's,     Of  the  11  nega- 
tively correlated  instructional  variables  v/hich  indicated  adults  with 
small  groups,  eight  of  them  liad  a  correlation  of  -,40  or  greater. 

In  those  classrooms  that  had  a  high  occurrence  of  adults  ask-- 
ing  children  direct  academic  questions,  the  children  scored  low  on  the 
Raven's  (Var.  354a,  357a,  451a,  485c),     Responses  to  direct  questions 
require  recall  of  previously  learned  information  and  this  approach  may 
not  stimulate  an  inquiry  menhod  of  thinking.     Children  responding  to 
adult  direct  questions  (Var,  358a,  360a,  362a,  and  493c),  also  had  a 
negative  correlation  with  the  Raven's,     However,  children  giving  ex- 
tended responses  to  adult  questions  (Var,  585c)  had  a  positive  corre- 
lation with  the  Raven's  test  scores. 

Low  scores  on  the  Raven's  were  found  in  classroom  environments 
where  adults  praised  and  reinforced  the  children,  either  for  academics 
or  behavior  (Var,  395a,  398a.,  399a,  400a,  40la,  402a,  403a,  406a,  457a, 
and  469a),     The  high  negative  correlation  (-,51)  for  the  traditional 
question-response-feedback  (Var,  412a)  sequence  is  quite  interesting. 
This  instructional  process  appeared  to  have  an  adverse  relationship  with 
problem  solving  as  measured  by  the  Raven's.    Tokens  for  academic  and  be- 
havior (Var,  399a,  400a,  and  401a)  also  showed  a  negative  correldLion, 
(However,  the  preceding  variables  were  positively  related  to  rv^ading  and 
math  scores,**)    When-'t|ie  children  gave  the  corrective  feedback  (Var. 
524c),  however,  the  correlation  became  positive.     In  s^ch  a  situation, 
the  children  are  n^t  the  re&ptSnders  but  the  initiators, 

\ 

When  children  spent  a  good  portion  of  their  school  day  waiting — 
either  for  ai.  adult  or  Xo  start  a  new  activity — they  may  not  have  had  the 
necessary  exposure  to  the  stimuli  that  would  enhance  their  perceptual 
problem-solving  ability.     The  variable  "Waiting^*  (Var,  546c)  was  nega- 
tively correlated  with  the  test  scores.    The  variables  which  correlated 
positively  were  those  that  also  described  the  more  open  models.    Data  on 
Table  108  indicate  that  the  four  open  models  included  in  this  analysis 
(Far  West,  University  of  Arizona,  Bank  Street,  and  EDC)  had  mean  raw  scores 
higher  than  those  of  the  more  structured  models  (University  of  Kansas  and 
University  of  Oregon) .     Residual  gain  scores  adjusted  for  the  baseline 
WRAT  Gtill  showed  that  University  of  Arizona,  Bank  Street,  and  EDC  were 


See  Section  VIII  page 
See  Scsction  VIII  page 
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Table  108 


MEANS  AND  STANDARD  DEVIATIONS  ON  THE  RAVEN *S  COLOURED  PROGRESSIVE 
MATRICES  TEST  FOR  SPONSORS*  AND  NON-FOLLOW  THROUGH 


Relative 
Difference  in 
Adjusted  Raven's 
Var.  440/Fall        Var.  448/Raven*s        Scores  Among 
1969  WRAT  Raw  Score  Sponsors  and  NFT 

Standard  Standard  Standard 

Sponsor  and  Number       Mean      Deviation    Mean      Deviation    Mean  Deviation 

Far  West  (N=14)  40.78  3.31  21.16  1.81  .42  1.69 
University  of  Arizona 

(N=2)  28.20  .28  19.83  1.65  1.69  1.59 

Bank  St  -et  (N=7)  32.42  6.78  19.54  2.56  .63  1.65 
University  of  Kansas 

(N=4)  33.50  6.37  18.39  ,  2.92  -.84  1.95 

UnivHrsity  cf  Oregon 

^  35.16        5.82         17.59       2.37         -1.99  1.42 

EDC  (N^6)  26.38        6.95         19.02       1.09  1.25  1.71 

Non-Follov  Through 

(N=13)  38.75        8.71         20.74       2.12  .52  1.40 


Too  few  Hip;h/Scope  third  grade  classrooms  w^ere  both  tested  and  observed  to 
permit  including  the  High/Scope  model  in  the  analysis. 


higher  than  Non- Follow  Through.*    Far  West's  baseline  WRAT  score  was  so 
much  higher  thai*  other  sponsors  that  an  adjustment  for  baseline,  shows  very 
little  gain  for  them  even  though  their  raw  score  was  higher  than  all  other 
sponsors  and  Non-Follow  Through.    Conversely,  the  process  variables  which 
correlated  negatively  with  the  Raven's  describe,  for  the  most  part,  more 
structured  models  and  both  University  of  Oregon  and  University  of  Kansas 
scored  lower  on  the  Raven's  than  othrr  sponsors. 

The  reader  is  reminded  that  only  a  few  classrooms  per  sponsor 
are  represented  in  this  analysis;  nevertheless,  the  findin;^<;  in  the 


These  adjusted  scores  indicate  that  relative  to  all  classrooms  in  the 
sample  these  sponsors  have  gained  when  entering  ab:.lity  is  parceled  oul. 
This  is  identified  as  a  residual  gain  score..    The  n.2an  ot  the  total  class- 
rooms is  zero;  therefore,  sonie  sponsors  will  have  a  .ninus  pccre  relative 
to  all  others. 
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partial  correlation  analysis  and  the  scores  on  the  test  for  each  sponsor 
support  the  notion  that  children  are  likely  to  do  better  in  perceptual 
problem  solving  tests  if  they  are  in  classrooms  that  use  instructional 
processes  similar  to  those  in  the  more  open  models. 

5 .  Relationships  Between  Scores  on  the  Coopersmith 
and  Instructional  Process  Variables 

The  Coopersmith  test  is  an  inventory  of  self-esteem*    The  in- 
strument is  designed  to  assess  the  child ^s  feelings  about  himself  and 
his  school.     It  also  assesses  how  he  thinks  others  feel  about  him.  An 
SRI-trained  tester  reads  aloud  a  series  of  statements  to  the  class  (for 
example,  **I'm  a  good  worker")*     The  child  is  asked  to  decide  whether  the 
statement  is  "like  me"  or  **not  like  me/'    The  test  is  scored  by  totalling 
the  responses  indicating  a  positive  sense  of  self-esteem.     (See  Appendix 
S  for  test  items.)     Correlations  were  computed  using  340  instructional 
process  variables  and  Coopersmith  test  scores  (partialling  out  Wide  Range 
Achievement  Test  scores).     Only  fourteen  instructional  variables  were 
found  to  be  signif icrntly  correlated.    Since  all  of  these  could  have  oc- 
curred by  chance,  the  results  of  this  analysis  will  not  be  discussed. 
An  analysis  of  variance  examining  sponsor  means  also  showed  no  difference 
amv ng  sponsor  or  Non-Follow  Through  adjusted  mean  scores. 

6.  Relationships  Between  Scores  on  the  Intellectual  Achievement 
Resj)onsibilitx  Scale  (lAR)  and  Instructional  Process 
Variables 

Tills  test  is  designed  to  assess  the  extent  to  which  th^  child 
accepts  responsibility  for  his  success  and  failures  in  intellectual  or 
academic  achievement  situations. 

a.  Procedures 

The  tester  describes  a  positive  or  negative  achievement 
experience  and  two  alternative  explanations  of  the  events.     One  response 
irdicates  internal  control  ^nd  the  other  indicates  external  control. 
The  child  is  asked  to  mark    he  response  that  best  describes  the  way  he 
really  feels.    Appendix  S  IxSts  the  test  iter^s.    Although  a  single  score 
is  usually  Lomputed  for  the  lAR,  tvo  scores  were  computed  for  this  anal- 
ysis, for  the  lAR  administered  to  58  -hird  grade  classrooms.    The  in- 
vestigators thought  it  would  be  interesting  to  see  whether  children  dif- 
ferea  in  their  viev;  of  responsibility  toward  their  own  success  and  their 
own  failure.     Th'j  first  scale  u^ed  items  on  the  lAR  that  describe  only 
v;hy  the  child  has  succeeded.     Th-^  second  scale  used  items  that  describe 
only  why  ti."  .,r.ild  has  failed.     Ihe  scales  were  Independent,  and  a  child 
could  score  hig  ;  on  both  scales. 
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Correlations  Wiire  computed  between  the  instructional 
process  variables  and  the  two  scores  on  the  lAR — and  the  dr.ca  were 
adjusted  for  the  baseline  Wide  Range  Achievement  Test  test  score*  These 
tests  were  administered  in  third  grade  only* 


b.  Findings 

1)      Responsibility  for  Success 

On  the  17  test  items  that  related  to  the  child's  view 
of  his  success,  the  data  indicate  that  children  attributed  their  success 
to  themselves  more  often  in  classrooms  where  children  were  allowed  to 
engage  in  activities  independently  (see  Table  109  ,  Var»  117,  118,  136, 
162,  184)*     Two  related  variables  that  described  cdults  involved  in 
classroom  management  type  of  activities  that  do  not  include  children 
(Var*  85,  103)  also  support  the  notion  that  children  accepted  the  respon- 
sibility for  their  own  success  when  they  were  allowed  to  be  independent 
in  their  work*    This  type  of  positive  relationship  was  also  found  where 
children  initiated  requests  and  asked  direct  questions  (Var*  477c)*  A 
somewhat  baffling  positive  relationship  is  that  with  transitiona  .  activ- 
ities (Var*  79)*    This  variable  described  those  times  when  children  were 
cleaning  up  the  room,  getting  ready  to  leave  the  room,  washing  their 
hands,  or  changing  to  some  other  activity*     It  is  a  little  difficult  to 
say  that  in  classrooms  where  transitional  activities  took  place  more 
often,  the  children  took  more  responsibility  for  their  success*  Perhaps 
during  these  transitory  times  the  children  had  a  greater  opportunity  to 
fend  for  themselves  and  thus  felt  more  responsible  for  their  success. 
Certainly,  the  previously  mentioned  correlations  suggested  that  the  more 
opportunity  the  child  has  to  behave  in  an  independent  manner,  the  more  he 
takes  responsibility  for  his  success* 

Conversely,  on  the  average  children  scored  lower  on 
responsibilit>  for  their  success  when  they  were  more  often  in  a  relation- 
ship with  an  adult  (Var.  113).     This  finding  is  notable  for  any  small  group 
variable  (Var.  88,  106,  145,  157).     Children  did  not  accept  responsibility 
for  their  success  (thus  indicating  they  may  have  thought  the  adult  was  re- 
sponsible for  their  success)  when  adults  questioned  them,   (Var.  357a)  or 
when  they  were  part  of  a  group  responding  to  the  adult's  questions  (Var. 
494).     In  order  to  accept  responsibility  for  success,  the  child  may  need 
to  be  tha  initiator  and  not  the  responder. 

A  variable  created  by  the  SRI  staff  called  *'self- 
esteem"  is  composed  of  four  variables:    child  praise,  child  correcti^'e 
feedback,  statements  of  self  worth,  and  extended  responses  (Var*  466a)* 
In  classrooms  where  childien  demonstrated  this  type  of  self-esteem,  they 
did  not  take  responsibility  for  their  success  as  often.    The  SRI  variable 
self-esteem  is  a  composite  that  needs  further  refining*    We  cannot  ex- 
plain this  strong  negatime  rrilationship  between  the  SRI  indicators  of 
self-esteem  and  the  child's  accepting  responsibility  for  success.  Test 
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Table  109 


lAR-SUCCESS  SCALE 
(58  Third  Grade  Classrooms) 


Variables 


No, 


Name 


ACTIVITIES 

79      Transitional  activities 
TIME  SPENT  AND  ACADEMIC  INTERACTION 

17      Total  class  duration 
GROUPINGS 

Adults  Without  Children 

85      Teacher  without  children 
103      Adult  without  children 

Adults  with  Small  Group 

88  Teacher  with  small  group 

106  Adult  with  small  group 

145  Small  group  with  teacher/Reading 

157  Small  group  with  any  aduitf./Reading 

Independent  Children 


INTERACTIONS 
Child  Questioning 


.46  .001 


-.29  .05 


.31 
.27 


,29 
,27 
,39 
.30 


477c    Child  commands,  requests,  and  direct  questions,  non- 
academic 


.05 
.05 


.05 
.05 
.001 
.05 


117 

Largt  group  of  children  independent 

.44 

.001 

118 

All  children  independent 

.33 

.01 

136 

One  child  independent/Math 

.34 

.01 

162 

Large  group  of  children  independent/Reading 

.34 

.01 

184 

Small  group  of  children  independent/Social  Studies 

.27 

.05 

Miscellaneous 

113 

Overall  occurrence  of  children  with  any  adult 

-.33 

.01 

.29  .05 


ERIC 
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Table  109  (Concluded) 


lAR-SUCCESS  SCALE 
(58  Third  Grade  Classrooms) 


Variables 


No .  Name 


ERIC 


Adult  Questioning 

357a    All  adult  questions  to  children  -.34  .01 

Child  Responsiveness 

A94c    Child  group  responds  to  adult  academic  command, 

request,  or  direct  question  -.26  .05 

Conversational  Statements 

466a    Child  self-esteem  -.39  .001 

Add:      52  Child  praise 

53  Child  corrective  feedback 

93  C.ild  statements  of  self-worth 

114  Child's  extended  response  to  questions 


data  on  Table  110  indicate  that  Far  West  Lab  and  EDC,  who  had  the  highest 
residual  gain  scores  on  "Independence"  in  the  child  behavior  outcomes, 
also  showed  the  most  gain  in  the  Success  scale  of  the  lAR.    The  lowest 
residual  gain  score  was  that  of  University  of  Kansas  and  some  of  their 
process  variables  were  the  same  as  those  which  correlated  negatively  with 
the  lAR  Success  scale.    The  findings  indicate  that  less  structured  class- 
rooms which  allowed  children  more  choice  and  independence,  as  illustrated 
by  Far  West  and  EDC,  were  more  likely  to  have  children  who  took  responsi- 
bility for  their  own  success  as  measured  on  the  TAR. 

2)      Responsibility  for  Failure 

Classrooms  where  children  took  responsibility  for 
their  failure  were  classrooms  where  children  were  most  often  in  large 
group  instruction  (Var.  107,  112,  127,  135,  146,  158,  162,  223,  441a, 
471a),  as  shown  in  Table  111.     They  took  responsibility  for  tneir  fail- 
ure in  classrooms  that  had  a  higher  child-to-adult  ratio,  that  emphasized 
academic  subjects  (reading  in  particular),  and  that  used  a  stimulus- 
response-feedback  type  of  interaction  during  academic  instruction  (Var. 
15,  16,  67,  163,  240,  242,  435a,  485c,  582c).     It  is  curious  that  chil- 
dren in  this  type  of  more  structured  academically  oriented  environment 
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Table  111 


lAR— FAILURE  SCALE 
(58  Third  Grade  Classrooms) 


Variables 


No. 


Name 


MATERIALS 

26      Games,  toys,  play  equipment  used 
44      Total  number  different  resource  categories  oded 
"present'*  over  three  days 

237  Audio  visual  equipment/Academic  activities 

238  Exploratory  materials/Academic  activities 

239  Math  or  science  equipment/Academic  activities 

240  Texts,  workbooks/Academic  activities 

241  Puzzles,  games /Academic  activities 

ACTIVITIES 

24  Child  selection  of  seating  and  work  groups 

62  Group  time 

63  Story,  music,  dancing 

67  Reading,  alphabet,  language  development 

82  Wide  variety  of  activities,  concurrent 

83  Wide  variety  of  activities,  over  one  day 

244  Group  time/Longitudinal 

245  Story,  music,  dancing/Longitudinal 

246  Arts,  craf ts/Longi?:udinal 

247  Guessing  games,  table  games,  puzzles/Longitudinal 
254  Dramatic  play,  dress-up/Longitudinal 

256  Practical  skills  acquisition/Longitudinal 

TIME  SPENT  AND  ACADEMIC  INTERACTION 

163      Approximate  number  of  children  involved  in  reading, 
all  days  observed 

242  Percent  of  CCLs  on  which  an  academic  activity  is 

occurring 

435a    Total  academic  verbal  interactions 
GROUPINGS 

Adults  in  the  Classroom 
15      Child/teacher  and  aide  ratio 


(Number  of  children  over  the  number  of  teachers  and 


-.30  .05 

.30  .05 

-.27  .05 

-.26  .05 

-.29  .05 

.26  .05 

-.35  .01 


-.45  .001 

-.46  .001 

-.30  .05 

.31  .05 

-.40  .01 

-.43  .001 

-.43  .001 

-.29  .05 

-.36  .01 

-.28  .05 

-.35  .01 

-.28  .05 


.32  .01 

.31  .05 
.30  .05 


aides) 
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Table  111  (Continued) 


IAR~FAILURE  SCALE 
(58  Third  Grade  Classrooms) 


Variables 


No .  Name 


ERIC 


Adults  in  the  Classroom  (Continued) 

16      Child/adult  ratio 

(Number  of  children  over  the  number  of  teachers, 
aides,  and  volunteers)  ,34  .01 

Adults  Without  Children 

231      Volunteer  involved/Classroom  management  ,29  ,05 

Individualized  Attention 

92  Aide  with  one  child  -,28  ,05 

124  One  child  with  aide/Math  -.29  .05 

143  One  child  with  teacher/Reading  -,20 
164      Personalized  instruction  in  reading  -,29  .05 
258      Aide  with  one  cnild,  academic  activities/Longi- 
tudinal -,31  ,05 

Adults  with  Two  Children 

93  Aide  with  two  children  -,43  001 
105  Adult  with  two  children  -,43  .001 
110      Two  children  with  any  adult                                               -,31  .05 

125  Two  children  with  aide/Math  -,37  ,01 
133      Two  children  with  any  adults  -,37  .01 

144  Two  children  with  teacher/Reading  -,28  ,05 
148  Two  children  with  aide/Reading  -,33  .01 
156      Two  children  with  any  adults/Reading  -•32  .05 

Adults  with  Small  Oroup 

201      Small  group  with  any  adults/Science  -,28  .05 

222      Small  group  of  children  with  any  adults/Arts  and 

Crafts  -,41  .01 

Adults  with  Large  Group 

107      Adult  with  large  group  .37  .01 

112      Large  group  of  children  with  any  adult  .30  .05 

123      Large  group  with  teacher/Math  ,41  .01 

135      Large  group  with  any  adults/Math  .46  .001 
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Table  111  (Concinued) 


lAR— FAILURE  SCALE 
(58  Third  Grade  Classrooms) 


Variables 


N'o. 


Name 


Adulcs  with  Large  Group  (Continued) 


146 
158 
223 


Large  group  with  teacher/Reading 
Large  group  v;ith  any  adults/Reading 
Large  group  of  children  with  any  adults/Arts  and 
Crafts 


27 

,30 


.05 
.05 


28  .05 


Independent  Children 

115  Two  children  independent 

116  Small  group  of  children  independent 

138  Small  group  of  children  independent/Math 

142  All  children  independent/Math 

159  One  child  independent/Reading 

161  Small  group  independent/Reading 

162  Large  group  of  children  independent/Reading 

260      Children  independent,  academic  activities/Longi- 
tudinal 


-.35 
-.54 
-.54 
-.46 
-.27 


,01 

,001 

,001 

.001 

.05 


-.48  .001 
.33  .01 

-.35  .01 


INTLRACT  ION'S 


Child  Questioning 

346a    Child  commands,  requests,  and  direct  questions,  non- 
academic 

348a    Child  open-ended  ques.tions,  nonacademic 
350a    Child  questions  to  adults 
450a    All  child  open-ended  questions 


,41 
.28 
.36 


.01 
.05 
.01 


,30  .05 


Adult  Questioning 

352a    Adult  commands,  requests,  and  direct  questions  to 

individual  children,  nonacademic 
355a    Adult  open-ended  questions  to  children,  nonacademic 
452a    Adult  open-ended  questions  to  children 
485c    Adult  commands,  requests,  and  direct  questions  to 

individual  children,  academic 
582c    Adult  academic  commands,  requests,  and  direct  ques- 
tions to  children 


,27 
.39 
.32 

.32 

.32 


.05 
.01 
.05 

.01 

.05 


ERIC 
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Table  111  (Concluded) 


lAR— FAILURE  SCALE 
(58  Third  Grade  Classrooms) 


 Variables 

No .  Name 


Child  Responsiveness 

i59a    Child  responses,  nonacademic 
368a    Child  responses  to  adult  open-ended  questions 
369a    Child  extended  response,  nonacademic 
493c     Individual  child  responds  to  adult  academic  command, 
request,  or  direct  question 

Adult  Responsiveness 

365a    Adult  responses  to  child  requests  or  questions, 
nonacademic 

366a    Adult  responds  to  child  questions  with  open-ended 
question 

Instruction 

373a    Adult  instruction,  nonacademic 
Conversational  Statements 

343a    Child  to  adult,  all  verbal  except  response 
388a    Child  task-related  comments  to  adults 
456a    All  child  task-related  comments 
476c    Verbal  interactions  among  children 
517c    Child  task-related  comments  to  children 
587c    All  child  task-related  comments 

Child  Behavior 

514c    Two  childre-     orking  together,  using  concrete 
objects 

515c    Small  group  working  together,  using  concrete 

objects 
546c    Child  waiting 
598c    Child  cooperation 

Communication  Focus 

439a    Adult  communication  or  attention  focus,   two  children 
441a    Adult  communication  or  attention  focus,  large  group 
471a    Adults  attentive  to  large  group 

Miscellaneous 

444a    Adult  movement 
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did  net  accept  responsibility  for  their  own  success,  but  did  accept  re- 
sponsibility for  their  failures.    These  children  seem  to  be  saying:  "If 
I  do  well,  it  is  because  of  the  teacher;  but  if  I  do  poorly,  it  is  be- 
cause of  my  own  failings." 

There  were  62  significant  negative  correlations  be- 
tween accepting  responsibility  for  failure  and  an  instructional  variable. 
Children  who  did  not  accept  responsibility  for  their  own  failure  were 
from  clasbrooms  which  allowed  a  child  to  select  his  own  seating  and  groups 
and  provided  a  wide  variety  of  materials  and  activities  (Var.  24,  26,  44, 
62,  63,  82,  83).     Children  from  classrooms  that  allowed  children  to  be 
independent  and  provided  personalized  attencion  and  instruction  were  more 
likely  to  view  the  cause  of  their  failure  as  something  outside  of  them- 
selves (see  Table  111). 

In  classrooms  where  children  took  verbal  initiative, 
asked  questions,  engaged  in  task-related  conversation,  or  responded  to 
adults'  open-ended  questions,  children  were  more  likely  to  view  thei^" 
failures  as  someone  else's  fault  (e.g.,  "Someone  bothered  me,"  or  "The 
book  is  too  hard").     The  variables  which  in  part  described  University  of 
Oregon  and  University  of  Kansas  were  positively  correlated  with  accepting 
responsibility  for  failure.     These  two  models  and  Non-Follow  Through  had 
higher  residual  gain  scares  than  all  other  models  (see  Table  110) .     If  chil- 
dren are  to  take  responsibility  for  their  own  failure  as  measured  by  the 
lAR,  it  would  seem  advisable  to  use  some  of  the  instructional  processes 
(if  the  University  of.  Kansas  and  University  of  Oregon.     In  these  structured 
models,  the  expectations  of  children  are  very  clear  and,  we  hypothesize 
if  a  child  fails  he  is  aware  that  he  did  re"  respond  to  the  task  properly. 
Excepting  EDC,  cnildren  in  the  classrooms  of  the  more  open  models  took 
less  responsibility  for  their  failure.     Far  West,  University  of  Arizona, 
and  Bank  Street  adjusted  scores  were  relatively  lower  than  the  means  for 
all  classrooms. 


c .  Summary 

Findings  from  this  study  seem  to  indicate  that  class- 
rooms that  allow  more  independence  have  children  who  accept  respons- 
ibility for  their  success.     However,  classrooms  that  allow  more  child  in- 
volvement in  selecting  their  groups,  that  allow  child^  independence  in  activ- 
ities, that  provide  individualized  instruction,  and  that  have  a  wide 
variety  of  activities  and  materials,  do  not  as  often  have  children  who 
accept  responsibility  for  their  own  failure. 

On  the  other  hand,  children  who  are  in  classrooms  that 
are  more  teacher-directed — and  who  experience  education  more  often  in 
large  groups — are  more  likely  to  attribute  their  success  to  the  teacher 
or  to  easy  work.     The  failure  of  children  in  the  more  structured, 
teacher-directed  classrooms  is  accepted  by  the  child  as  his  own  failure. 

Interestingly,  the  Non-Follow  Through  classrooms  had  posi- 
tive gain  scores  on  both  the  success  and  failure  scores  (see  Table  HO). 
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In  Tact,  children  in  Non-Kollow  Through  classrooms  took  more  lesponsibil- 
ity  for  their  failure  than  children  in  any  of  the  sponsors'  classrooms. 
Perhaps  this  is  explained  by  the  fact  that  within  the  Non-Follow  Through 
sample,  there  was  a  wide  range  of  classroom  structures.     It  may  be  recalled 
from  Chapter  VI  that  in  the  third  grade  sample,  there  were  16  classrooms 
that  were  classified  as  University  of  Oregon  classrooms  on  the  PEI  and 
CCL  variables  and  whose  children,  according  to  the  previous  findings, 
would  accept  responsibility  for  failure*     EDC  had  the  highe  .  gain  score 
for  all  sponsors  on  the  Success  scale  vind  ten  of  tne  Non-Foiiow  Through 
classrooms  were  classified  as  P^DC;  thus,  in  these  classrooms  the  children 
would  be  more  likely  to  take  responsibility  for  their  success.     It  is  of 
note  that  EDC  was  the  only  sponsor  to  show  positive  gain  on  both  scales, 
l-Jhile  all  raw  scores  were  similar  for  all  of  the  sponsors,  children  in  EDC 
classrooms  entered  school  with  lower  baseline  WRAT  scores  so  that  the  ad- 
justment of  raw  scores  for  entering  ability  was  in  EDC's  favor.  Neverthe- 
less, upon  adjustment  of  entering  baseline  scores,  correlations  indicated 
that  children  in  EDC  classrooms  were  more  accepting  than  children  in  other 
classrooms  of  responsibility  for  both  their  own  failure  and  success. 


7 ,      Relationship  Between  Scores  on  the  MAT  Math  and  Reading 
Subtests  and  Instructional  Process  Variables 

It  is  of  general  interest  to  educators  to  understand  how  in- 
structional processes  affect  a  child's  ability  to  show  gains  on  standard- 
ized reading  and  math  achievement  tests.     The  MAT  was  given  in  Spring 
1973.     108  first  grades  and  58  third  grades  were  included  in  the  sample. 
See  Table  101  for  the  classroom  and  site  breakdown  by  sponsor.     From  the 
data,  correlations  were  computed  between  340  instructional  variables  and 
classroom  mean  scores  on  reading  and  math  tests  for  each  grade  (first  ad- 
justing for  the  baseline  \-lKkT  scores). 


ERLC 


a.      Math  Correlations 

This  section  presents  the  significant  correlations  between 
instructional  variables  and  total  math  test  scores  for  the  first  grade 
and  three  subscores  on  the  math  test  for  the  third  grade.     Of  the  340 
correlations  that  were  computed,  approximately  17  significant  correla- 
tions (p  <  ,05)  could  have  occurred  by  chance.     Since  there  are  so  many 
variables  and  no  way  of  identifying  which  may  have  occurred  by  chance, 
variables  that  correlated  at  both  grade  levels  and  those  that  correlated 
across  all  subscores  caa  be  interpreted  with  more  confidence. 

T^^70  variables  that  represent  the  extent  of  opportunity 
to  engage  in  math  activities  (Var.  17  and  66)  were  positively  related  to 
math  scores  in  both  the  first  and  the  third  grades  (see  Table  112), 
In  some  cases,  the  lengths  of  time  children  spend  in  school  varied  by  as 
much  as  2  hours,     Ulien  the  school  day  is  longer,  children  may  have  more 
opportunities  to  engage  in  math.     The  correlation  of  the  average  rate 
of  occurrence  of  math  and  high  test  scores  was  strong  in  all  of  the 

275 


Table  112 


PARTIAL  CORREUTIONS  OF  MAT  MATH  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


First   '  Third  Grade  (N-58)  

Grade  Math  Math 

(N»108*)  Conp'jta-           Math  Problem 

 Variables                                  Total  Math  t ion           Concepts       Solving       Total  Math 

No.   Name                                     r         p<  r         p<        r         p<        r         p<        r  p< 


MATERIALS 


25 

Games,  toys,  play  equipment  present 

-. 

15 

- 

46 

.001 

- 

38 

.01 

- 

32 

.05 

- 

.42 

.01 

26 

Games,  toys,  play  equipment  used 

-. 

04 

- 

36 

.01 

- 

36 

.01 

- 

26 

- 

.35 

.01 

28 

Instructional  materials  u3ed 

21 

.05 

- 

05 

- 

03 

- 

02 

- 

.04 

37 

Audio  visual  equipment  present 

04 

- 

45 

.001 

- 

37 

.01 

- 

35 

.01 

- 

.42 

.01 

38 

Audio  visual  equipment  used 

- 

28 

.01 

- 

39 

.Oi 

- 

18 

- 

24 

- 

.30 

.05 

lotai  number  different  resource  cate- 

gories coded  "present"  over  3  days 

- 

04 

- 

41 

.01 

- 

36 

.01 

- 

33 

.01 

- 

.  39 

.01 

45 

Total  number  different  resource  cate- 

gories coded  "used  today"  over  3  days 

- 

03 

- 

30 

.05 

- 

18 

- 

14 

.31 

- 

.23 

237 

Audio  visual  equipment/Academic 

ac t ivl t  ie3 

- 

30 

.01 

- 

22 

- 

19 

- 

25 

.06 

- 

.23 

238 

Exploratory  materials/Academic 

activities 

- 

04 

- 

30 

.05 

- 

23 

14 

.30 

- 

.25 

239 

Math  or  science  equipment /Academic 

activities 

- 

03 

- 

20 

- 

29 

.05 

- 

26 

- 

.26 

.05 

240 

Texts,  workbooks/Academic  activities 

09 

38 

.01 

18 

17 

.27 

.05 

241 

Pa:jzles,  games /Academic  activities 

- 

15 

- 

30 

.05 

- 

22 

- 

24 

- 

.27 

.05 

ACTIVITIES 

24 

Child  selection  of  seating  and  work 

groups 

09 

32 

.05 

- 

31 

.05 

30 

.05 

.33 

.01 

62 

Group  time 

21 

.05 

43 

.00] 

35 

.01 

25 

: 

.38 

.01 

63 

Story,  music,  dancing 

- 

03 

- 

52 

.001 

- 

46 

.001 

- 

37 

.01 

- 

.A8 

.001 

64 

Arts,  crafts 

- 

23 

.05 

- 

26 

- 

15 

- 

11 

- 

.20 

66 

Numbers,  math,  arithmetic 

29 

.01 

59 

.001 

42 

.01 

43 

.01 

.52 

.001 

67 

Reading,  alphabet,  language  development 

18 

40 

.01 

26 

19 

.31 

.05 

68 

Social  studies,  geography 

15 

13 

28 

.05 

18 

.21 

69 

Science,  natural  world 

06 

27 

.05 

21 

18 

.24 

71 

Blocks,  trucks 

18 

22 

33 

.01 

29 

.05 

.29 

.05 

73 

Active  play 

26 

.01 

29 

.05 

19 

18 

.24 

76 

Social  interaction 

08 

18 

25 

33 

.05 

.26 

.05 

77 

Unoccupied  child 

12 

45 

.001 

37 

.01 

42 

.01 

.44 

.001 

80 

Classroom  management 

33 

.001 

10 

09 

04 

.06 

82 

Wide  variety  of  activities,  concurrent 

07 

14 

33 

.01 

28 

.05 

.26 

83 

Wide  variety  of  activities,  over  one  day 

13 

44 

.001 

42 

.01 

40 

.01 

.45 

.001 

84 

Approxlmatf  number  of  children  in  the 

classroom  in  any  activity 

29 

.01 

29 

.05 

28 

.05 

17 

.27 

.05 

244 

Group  Lime/Longl tudlnal 

20 

.05 

32 

.05 

28 

.05 

.28 

.05 

245 

Story,  music,  dancing/Longitudinal 

05 

45 

.001 

43 

.001 

34 

.01 

.44 

.001 

246 

Arts,  crafts/Longitudinal 

28 

.01 

34 

.01 

27 

.05 

25 

.31 

.05 

24  7 

Guessing  games,  table  games,  puzzles/ 

Longl tudlnal 

12 

26 

22 

25 

.26 

.05 

248 

Numbers,  math,  arithmetic/Longitudinal 

31 

.01 

24 

02 

01 

.09 

249 

Reading,  alphabet,  language  development/ 
Longitrdina I 

09 

33 

.01 

10 

09 

.20 

251 

Science,  natural  world/Longitudinal 

04 

37 

.01 

38 

.01 

28 

.05 

.37 

.01 

253 

Blocks,  trucks/Longitudinal 

12 

19 

29 

.05 

27 

.05 

.26 

.05 

255 

Active  play/Longitudinal 

27 

.01 

23 

23 

25 

.25 

256 

Practical  skills  acquisition/Longitudinal 

16 

30 

.05 

19 

23 

.26 

Child  focus  variables,  which  are  identified  by  the  c  appearing  as  part  of  the  variable  code  number, 
pertain  to  105  r«ither  than  108  <!lassrooms. 
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Table  112  .Continued) 


f'AHIIAL  roRRKUr^ONS  OF  MAT  ^iAlH  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  AND  THIRD  GRADKS 
(Follow  Th'-ough  and  Non-Follow  Through) 


First 
Grade 
(N»108*) 


Third  Grade  (N«58) 


Math 
Computa- 


Math 


Math 
Prob^  em 


Var  iables 

Total 

Math 

t  ion 

Concep 

ts 

Solving 

Iota  1 

Math 

:;o. 

Name 

r 

r 

p< 

r 

r 

P< 

TIME 

SPENT  AMD  ACADLMIC  INTERACTION 

17 

Total  class  duration 

.25 

.01 

.40 

.01 

.39  . 

01 

.40 

.01 

.42 

.01 

140 

Approximate  number  children  involved 

in 

Math — all  days  observed 

.35 

.001 

.60 

.OOi 

.46  . 

001 

.40 

.01 

.53 

.001 

163 

Approximate  number  children  involved 

in 

Reading — all  days  observed 

.32 

.001 

.50 

.001 

.36  . 

01 

.28 

.05 

.41 

.01 

186 

Approximate  number  children  involved 

in 

Social  Studies--all  days  observed 

.15 

.11 

.27  . 

05 

.15 

.18 

242 

Percent  CCLs  in  which  an  academe 

activity  is  occurring 

.21 

.05 

.59 

.001 

.47 

001 

.42 

.01 

.53 

.001 

4  35a 

Tot<*l  academic  verbal  interactions 

.41 

.001 

.50 

.001 

.31  . 

05 

.35 

.01 

.42 

.01 

566r 

Total  academic  verbal  interactions 

.42 

.001 

.50 

.001 

.30  . 

05 

.34 

.01 

.42 

.01 

GROUPINGS 


Adults  in  the  Classroom 

15    Child/teacher  and  aide  ratio  (number 

children  over  teachers  and  aides) 
16.  Child/adult  ratio  (nunber  children  over 
teachers,  aides,  ar.d  volunteers) 
108    Overall  occurrences  of  adults 
262    Average  number  of  adults  m  the 
classroon/Longi  tud  inal 

Adults  Withouv  Children 

231  Volunteer  involved/Classrooi.*  panagement 
Individualized  Ai:tent ion 


.09 

.02 

.28  .01 


.23 


.06 


.05 


.15 

.17 
.07 

-.03 


.24 


.30  .05 

.31  .05 
.04 

.20 


.19 


.25 

.23 
-.02 

-.19 


.27  .05 


.24 

.25 
.01 

-.14 


.25 


86 

Teacher  with  one  child 

29 

.01 

-.14 

-.12 

09 

.13 

104 

Adult  with  one  child 

21 

.05 

-.14 

-.12 

08 

.12 

109 

One  child  with  any  adult 

20 

.05 

-.15 

-.16 

08 

.14 

143 

One  child  with  teacher/Reading 

26 

.01 

-.27 

.05 

-.17 

13 

.21 

155 

One  child  with  any  adults/Reading 

19 

.05 

-.25 

-.18 

12 

.20 

164 

Personalized   instruction  in  Reading 

22 

.05 

-.34 

.01 

-.27 

.05 

18 

.29 

.05 

257 

Teacher  with  one  child,  academic 

act ivi  ties/ Longitudinal 

28 

.01 

-.18 

-.13 

11 

.15 

Adults  with  Two  Children 

87 

Teacher  with  two  children 

26 

.01 

-.32 

.05 

-.  J8 

.01 

32 

.05 

.36 

.01 

105 

Adult  with  two  child  ^n 

19 

-.29 

.05 

-.32 

.05 

23 

.30 

.05 

110 

Two  children  with  any  adult 

16 

-.24 

-.26 

.05 

14 

.23 

121 

Two  children  with  teacher/Math 

14 

-.23 

-.27 

.05 

26 

.27 

.05 

133 

Two  children  with  any  adults/Math 

15 

-.25 

-.33 

.01 

23 

.29 

.05 

144 

Two  children  with  teacher/Reading 

23 

.05 

-.40 

.01 

-.33 

.01 

28 

.05 

.36 

.01 

148 

Two  children  with  aide/Reading 

24 

.01 

-.27 

.05 

-.24 

10 

.22 

156 

Two  children  with  any  adults/Reading 

16 

-.38 

.01 

-.33 

.01 

22 

.33 

.01 

Adults  with  Small__Gr.'up 

88    Teacher  with  small  group 
94    Aide  with  small  group 
106    Adult  with  small  group 


.16 
-.00 
.09 


-.19 
-.17 
-.17 


-.30 
-.27 
-.29 


.05 
.05 
.05 


-.24 
-.29 
-.27 


.05 
.05 


-.25 
-.25 
-.26 


Child  focu?  variables 
pert.^iin  to  105  rather 


,  which  are  identified  by  the  c 
than  108  classrooms. 


appearing  as  part  of  the  variable  code  number. 
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Table  112  (ConC-'nued) 


PARTIAL  CORRELATIONS  OF  MAT  MATH  SCORES  WITH  INSTRUCxIONAL  VrJllABLSS 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


First 

Third 

Grade  (N=58) 

Grade 

Math 

Math 

(N«108*) 

Computa- 

Math 

Problem 

Variables 

*.  3  tal 

Math 

t  ion 

Concepts 

Solving 

Total 

Math 

No .  Name 

JL — 

D<  ■ 

J" 

p< 

J" 

o< 

,r 

r 

p< 

Adults  with  Small  Grou£  (Continued) 

111    Small  group  of  children  wit.  any  adult 

.  14 

14 

-.26 

05 

-.23 

-.22 

122    Small  group  with  teacher/Math 

- .  12 

-.41 

01 

-^34 

01 

-.24 

-.36 

.01 

i3A    Small  group  with  any  adults/Math 

-.10 

-.22 

-.30 

05 

-.28 

.05 

-.28 

.05 

1A5    Small  group  with  teacher/Reading 

.01 

-.25 

-.35 

01 

-.28 

.05 

-.31 

.05 

157    Small  group  with  any  adults/Reading 

.14 

-.18 

-.31 

05 

-.28 

.05 

-.27 

.05 

222    Smnll  group  of  children  with  any  adults/ 

Arts  and  crafts 

.  00 

23 

-.  31 

05 

-.  21 

-.27 

.05 

Adults  with  Large  Group 

89    Teacher  with  Icrge  group 

.  07 

.  39 

01 

.47 

001 

.  33 

.  01 

.  44 

.001 

107     AHiilr        ch  i  art^p  ^rotiD 

.06 

.  J  J 

ni 

UUl 

.  JO 

ni 

.  Ul 

.  40 

.  01 

1  n 

9 

A9 
.  ^Z 

ni 

Ul 

'^9 

.  .^z 

.  UD 

.  37 

.  01 

19*^     T^rop  OTmin  tj^rH   t" PAr'bpT* /NLfi  rh 

1  n 

.  J7 

ni 

^^9 
.  DZ 

UUl 

A  1 
.  41 

.  Ul 

.47 

001 

135    Large  group  with  any  adults/Math 

.  C  J 

.  *+  O 

nni 

UUi 

•iA 

UUl 

.  40 

(\(\  1 
.  UU 1 

.  52 

,  001 

x*4vF      L><iL>ccr   ji^L           wxuii  uu<iv.(icL/rvcr<iuxiiK 

1/. 

Ul 

/  "J 
.  4  J 

UUl 

.  33 

.  Ul 

.  39 

•  ux 

l,J\J       L/<1  L           K  t  ^^Up    WXUll    ulljr     uU  UX  L  O  /  [\c:  uU  X  IlK 

no 

AH 

Ul 

A  A 

UUl 

1  0 

.  JZ 

.  UI> 

.  41 

.  01 

^  ^           L>CI  L           KLv/Up     \J  X     V.(1XX\JLCI1    WxLlI    ulljr  aUUXLS/ 

L  U  \>     Cll l\J     V,  L  <1  X  C  9 

TnHpnpnHpnf"  f^hllHKPn 

X  llxi  Ci^CllxJ  Cll  U      wllXXU  L  Cll 

115     Two  r'hllHr'pn    \      f^rtf^nA  pn  r 

XX«/                       V^IIXXULCII      XI  l\i  CWCIlxi  CIIU 

-.22 

.05 

-.36 

01 

-.33 

01 

-.23 

- .  33 

.  01 

J 16    Small  group  of  children  Independent 

-.36 

.COl 

— .  J  J 

UX 

—  91 
— .  Z  J 

-.30 

.05 

118    All  children  independent 

-  "11 

ni 

-.20 

-.16 

-.03 

-.16 

136    One  child  independent/Math 

-.05 

-  34 

01 

-.35  . 

01 

-.21 

-.32 

.05 

137    Two  children  independent/Math 

-.11 

-.43 

001 

--.40 

o: 

-.31 

.05 

-.41 

.01 

138      ^mA  1  1    <?rotiD    Cif    r'hllHr'pn    ^  nH  onnpnii^->n  r  / 

^                 OUIO  X  X     j^Lv^U^     SJ  L      V»IIXX\iL  Cll     X  ll\i  UIIL/ CIIU  Cll  L  / 

Math 

-.37 

01 

-.46 

001 

-.38 

.01 

-.43 

.001 

1A2    All  children  independent/Math 

-.10 

-.39 

01 

-.39 

01 

-.29 

.05 

-.38 

.01 

159    One  child  independent/Reading 

-.13 

-  "19 

U  J 

.  Jl 

U  J 

.  Zl 

-.30 

.05 

160    Two  children  independent/Reading 

—    1 Q 

— .  ly 

.  \jj 

-  "IQ 

ni 

—  .  J  J  , 

n  1 
Ul 

—  19 
— .  JZ 

.  U  J 

-.38 

.01 

161    Small  group  of  children  independent/ 

Reading 

.  ZD 

.  Ul 

- .  Z  J 

— .  ZU 

-.11 

-.20 

J       r\XX     V.(1X  XU  L  Cll     XIIU  CpCIIU  Cll  U  /  [\CuU  X  IlK 

- .  23 

.  KJO 

.  it* 

.14 

— .  U4 

-.  16 

?OS     ^mij  11    OTawVi   c\f   r'hllHrpn  'InHpnpnHpnr/ 

A  \J  mJ         OUlaXX     i^Lk^UL/     ^'X      V»ilXX\iLCII  XII\iCL/CIIUCIIU/ 

Ov.  X  Clli-  c 

-.11 

-.29 

05 

-.29 

05 

-.21 

-  9ft 

—  •  iO 

.  \jj 

Z\  loCcx  xaUcOUo 

113    Overall  occurrence  of  children  wit'u  an> 

adult 

.31 

.01 

.20 

.16 

.08 

.16 

INTERACTIONS 

Child  Questioning 

3A6a  Child  commands,  requests,  and  direct 

quest  ions ,  nonacademic 

-.20 

.05 

-.51 

001 

-.40 

01 

-.43 

001 

-./)8 

.001 

350a  Child  questions  to  adults 

-.13 

-.32 

05 

-.32  . 

05 

-.29 

05 

-.33 

.01 

450a  All  child  open-ended  questions 

-.09 

-.-9 

-.28  . 

05 

-.20 

-.24 

A77c  Child  commands,  requests,  and  direct 

questions,  nonacademlc 

-.35 

.001 

-.38 

01 

-.26  . 

05 

-.26 

-.33 

.01 

Child  focus  variables,  which  are  Identified  by  the  c  appearing  as  part  of  the  variable  code  number^ 
pertatn  to  105  rather  than  108  classrooms. 
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Table  112  (ConCinued) 


PAKIIAL  COKRHUTIOS'S  OF  ^^AT  >iAVl  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  A^D  THIRD  GRADES 
(Kol'ow  IhrougM  and  Non-Follow  Through) 


First  Third  Grade  (N^'SS) 


Gradu  Math  Math 

(N=108*)        Computa-  Math  Problem 

Variables   Totalhath         t ion  Concepts        Solving       Total  Math 


No. 

Mane 

r 

p^ 

r 

P< 

r 

p< 

r 

r 

Adult  Questioning; 

351a 

ndult  jonunards,  recjuests,  ar»d  direct 
Cjuestions  to  groups  of  children,  non- 

acaden  i  c 

-.16 

-.28 

.05 

-.  17 

-.22 

-.24 

352a 

Adult  comr.iands,  requests,  and  dirtct 
question?;  to  Individual  children,  non- 

acadenii 

-,31 

.01 

-.47 

.001 

-.  31 

.05 

-.38 

.01 

-.42 

.01 

353a 

Adult  commands,  requests,  and  direct 
questions  to  groups  of  children. 

acadeni c 

.  10 

.53 

.001 

.52 

.001 

.45 

.001 

.54 

.001 

354a 

Adul  t  c omands  ,  requests ,  and  d irec  t 
questions  to  individual  children^ 

academic 

.23 

.05 

.30 

.05 

.09 

.08 

.»8 

355a 

Adult  open-ended  questions  to  children. 

no  nac  ad  em  it- 

-.'15 

-.42 

.01 

-.  36 

.01 

-.38 

.01 

-.42 

.01 

357a 

All  adult  quest  ions  to  children 

,11 

.32 

.05 

.24 

.12 

.25 

431a 

Adult  academic  commands,  requests,  and 

direct  questions  to  children 

.25 

.01 

.51 

.001 

.  36 

01 

.31 

.01, 

.43 

.001 

452a 

Adult  open-ended  questions  to  children 

-.03 

-.35 

.01 

-.30 

05 

-.29 

.05 

-  .  34 

.01 

485o 

Adult  conunands,  requests,  and  direct 
(questions  to  individual  children. 

academic 

.29 

.01 

.36 

.01 

.24 

.24 

.30 

.05 

488c 

All  adult  questions  to  children 

.21 

.05 

.36 

.01 

001 

.31 

.05 

.39 

.01 

582c 

Aiult  academic  cominands,  requests,  and 

direct  questions  to  children 

.32 

.01 

.57 

.001 

.51 

001 

,44 

.001 

.55 

.001 

Child  Responsiveness 

358c 

All  child  responses 

.26 

.01 

.44 

.001 

.28 

05 

.20 

.34 

.01 

359a 

Child  responses,  nonacademic 

-,26 

.01 

-.47 

.001 

-.  30 

05 

-.37 

.01 

-.41 

.01 

360a 

Chile  responses,  academif' 

.39 

.001 

.52 

.001 

.33 

01 

.30 

.05 

.42 

01 

362a 

One  child  responds  to  adult  academic 
commands,  requests,  or  direct  ques- 

tions 

.  01 

.  30 

.  05 

.09 

.09 

.  lo 

363a 

Child  j^roup  responds  t'o  a^ult  acadenic 
commands,  requests,  or  direct  ques- 

t  iono 

.14 

.54 

.001 

.45 

001 

.47 

.01 

.52 

.001 

363a 

Child  responses  to  adult  open-ended 

quest  ions 

-.03 

-.32 

.05 

-.26 

05 

-.24 

-.30 

.05 

369a 

Child  extended  response,  nonacademic 

.33 

.001 

-.36 

.01 

-.19 

-.24 

-.29 

.05 

370a 

Child  extended  response,  academic 

.29 

.01 

.35 

.01 

.26 

05 

.  3 

.01 

.34 

.01 

454a 

Chlld*s  extended  response  to  question 

.3^ 

.001 

.19 

.18 

22 

.21 

490c 

Child  responses,  nonacademi*,. 

-.28 

.01 

-.29 

.05 

-.16 

-.17 

-.23 

491c 

Child  responses,  academic 

.34 

.001 

.42 

.01 

.29 

05 

.30 

.05 

.37 

.01 

493c 

One  child  responds  to  adult  academic 

commands,  requests,  or  direct  questions 

.25 

.01 

.18 

.04 

.03 

.10 

544c 

Child  not  responding  to  adults 

.08 

.34 

.01 

.45 

001 

.40 

.01 

.42 

.01 

585c 

Child's  extended  response  to  questions 

.26 

.01 

-.20 

-.12 

-.04 

-.13 

Adul I  Responsiveness 

365a 

Adult  responses  to  child  requests  or 

questions,  nonacademic 

-.29 

.01 

-.50 

.001 

-.38 

01 

-.38 

.01 

-.45 

.001 

366a 

Adult  responds  to  child  question  with 

oper.-ended  question 

.03 

-.28 

.05 

-.13 

-.14 

-.20 

Child  foLUb  variables,  whi^h  art^  identified  by  the  {  appearing  as  part  of  the  variable  code  number, 
pertain  to  105  rather  than  108  ilassrooms. 
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Table  112  (Continued) 


PARTIAL  CORRELATIONS  OF  MAT  MATH  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


Fl'^sc  Third  Grade  (N«58) 


Grade  Math  Math 

(N"108*)       Compuca-  Math  Problem 

Variables  Total  Math         tlon  Concepts        Solving       Total  Math 


No,  Name 

p< 

r 

p< 

r 

p< 

r 

p< 

_r 

Adult  Responsiveness  (Continued) 

496c  Adult  responses  to  child  requests  or 

questions,  nonacademlc 

-.20 

05 

-.30 

.05 

-,32  . 

05 

-.21 

-.30 

.05 

545c  Adult  not  responding  to  child 

,12 

.22 

.35  . 

01 

.34 

.01 

.32 

.05 

Adult  Feedback 

394a  All  adult  acknowledgment  to  children 

.20 

.05 

-.03 

-.08 

-.10 

-.07 

395a  Adult  acknowledgment  to  children, 

academic 

.29 

.01 

,14 

.03 

.03 

.08 

397a  Adult  acknowledgment,  other  task- 

related 

-.13 

-.42 

.001 

-.27  . 

05 

-.33 

.01 

-.37 

.01 

398a  All  adult  praise  to  children 

.39 

.001 

.25 

.10 

.18 

.19 

399a  Adult  reinforcement  with  token. 

academic 

.38 

.001 

.15 

.02 

.01 

.07 

400a  Adult  reinforcement  with  token, 

behavior 

.37 

.001 

.12 

.03 

.00 

.08 

401a  Adult  reinforcement  with  token,  other 

task-related 

-.30 

.01 

.11 

.02 

-.03 

.04 

402a  Adult  praise,  academic 

.37 

.001 

.36 

.01 

.17 

.31 

.05 

.30 

.05 

403a  Adult  praise,  behavior 

.36 

.001 

.16 

.11 

.04 

.11 

404a  Adult  praise,  other  task-related 

-.06 

-.30 

.05 

-.21 

-.34 

.01 

-.30 

.05 

405a  All  adult  corrective  feedback  to 

chl Idren 

.31 

.01 

.16 

.  12 

.03 

.12 

406a  Adult  positive  corrective  feedback. 

academic 

.44 

.001 

.34 

.Ox 

.12 

.20 

.25 

407a  Adult  negative  corrective  feedback. 

academic  * 

.15 

.34 

.01 

.38  . 

01 

.18 

.32 

.05 

408a  Adult  positive  corrective  feedback. 

behavior 

-,04 

-.27 

,05 

-.19 

-.25 

-.26 

412a  Adult  feedback  to  child  response  to 

adult  academic  commands,  requests,  or 

questions 

.44 

.001 

.20 

.09 

.08 

.14 

432a  Adult  punishment  of  children 

.13 

.29 

.05 

.36  . 

01 

.24 

.32 

.05 

449a  Adult  nctural  corrective  feedback. 

academic 

.23 

.05 

.24 

.24 

,30 

.05 

.28 

.05 

457a  All  adult  positive  corrective  feedback 

.38 

.001 

.14 

.06 

.02 

.08 

469a  All  adult  reinforcement  with  tokens 

.41 

.001 

.15 

.02 

.01 

.07 

543c  Adult  feedback  to  child  response  to 

aciul  t  aca  d  em  I  c  c  ommand  s,  requests,  or 

quest  Ions 

.30 

.01 

.17 

.07 

.00 

.09 

580c  Adult  neutral  corrective  feedback. 

acad emic 

.26 

.01 

.07 

.02 

.04 

.05 

588c  All  adult  positive  corrective  feedback 

.31 

.01 

.06 

.16 

.23 

.15 

600c  All  adult  reinforcement  with  tokens 

.35 

.001 

.11 

.02 

-.05 

.03 

Instruction 

372a  Child  presenting  information  to  a  group 

.03 

.13 

.20 

.26 

.05 

.21 

373a  Adult  instruction,  nonacaderoic 

-.07 

-.39 

.01 

-.26 

05 

-.26 

-.33 

.01 

375a  Adult  instructs  an  Individual  child 

-.12 

-.26 

-.35 

01 

-.34 

.01 

-.33 

.01 

380a  Child  self-Instruction,  academic,  with 

objects 

-.03 

.33 

.01 

.32 

05 

.22 

.31 

.05 

455a  All  adult  instruction 

-.09 

-.28 

.05 

-.:6 

-.17 

-.22 

508c  Child  celf-instruction 

.10 

.30 

.05 

.09 

.10 

.19 

Child  focus  variables,  which  are  identified  by 

the  c 

appear Ing 

as  part 

of  the 

variable 

code 

number. 

pertain  to  105  rather  than  108  classrooms. 
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Table  112  (ConCinued) 


PARTIAL  CORREUTIONS  OF  MAT  MATH  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


First  Third  Graf^e  (N«^58)  

Grade  Math  Math 

(N=108*)  Computa-          Math  Problem 

 Variables  Total  Math  tion          Concepts        Solving       Total  Math 

No.  Nane  ^       r         p<  r         p<        r         p<       r         p<       r  p< 

Instruct  Ion  (Continued) 


^OQf    r'hiWl     coif— tn<:f'»'if/-»t'i/-\r«  ^/^'■^Aantt/^ 

n  1 
.  Ul 

.  J/ 

.01 

,  14 

.  19 

1  A. 

510c  Child  se  1  f " liis t r uc  ion,  objects 

.  34 

.  UU  i 

- .  10 

.  16 

-.15 

5llc  Child  self— Instruction,  academic,  with 

obj  ec  t  s 

.  34 

.  001 

02 

.04 

.06 

0' 

586(  All  adult  instruction 

.05 

.  12 

.  29 

26 

.05 

.  23 

599c  Child  self— instruction,  nonacademic 

.  26 

.  01 

- .  26 

-.16 

- 

27 

.05 

- .  24 

Cnild  Attending 

A*i**a  Child  attentive 

.03 

- .  29 

.05 

-.  15 

11 

-.20 

5A7c  Children  attentive  to  adults,  non- 

academic 

.  17 

-.  39 

.02 

-.21 

.26 

-.31 

.05 

59*>«'  Child  attentive 

.07 

-.36 

.01 

-.21 

25 

-.  30 

.05 

Conversational  Statements 

J.  i'4    Among  children/ Soc  ial  interaction 

— 

.05 

.27 

.05 

.35 

.01 

41 

.01 

.  36 

.01 

JAJa  Child  to  a^ult,  all  verbal  except  re- 

sponse 

.24 

.01 

-.45 

.001 

-.33 

.01 

36 

.01 

-.41 

.01 

344a  Individual  child  verbal  interactions 

with  adult 

05 

-.18 

-.27 

.03 

33 

.01 

-.27 

,05 

387a  Child  general  comments  to  adults 

- 

33 

.001 

-.29 

.05 

-.22 

- 

32 

.01 

-.30 

.05 

388a  Child  task-related  comments  to  adults 

— 

16 

39 

.01 

-.20 

- 

17 

-.28 

.  05 

389a  Adult  general  comments  to  children 

— 

32 

.001 

-.13 

-.06 

- 

18 

-.13 

390a  Adult  task-related  comments  to  children 

19 

-.41 

.01 

-.25 

20 

-.  32 

.05 

456a  All  child  task-related  comments 

03 

-.37 

.01 

-.19 

21 

-.28 

.05 

474c  Child  to  adult,  all  verbal  except 

response 

23 

.05 

-.26 

-.14 

20 

-.21 

476c  Verbal  interactions  among  children 

- 

18 

-.49 

.001 

-.36 

.01 

- 

34 

.01 

-.43 

.oo: 

516c  Social  interaction  among  children 

- 

28 

.01 

-.24 

-.13 

- 

18 

-.20 

517c  Child  task-related  comments  to  children 

03 

-.35 

.01 

-.30 

.05 

— 

26 

-.32 

.01 

518c  Child  general  comments  to  adults 

26 

.01 

-.35 

.01 

-.28 

.05 

38 

.01 

-.36 

.01 

520c  Adult  general  comments  to  children 

20 

.05 

-.15 

-.11 

20 

-.16 

587c  All  child  task-related  comments 

04 

-.32 

.05 

-.26 

21 

-.28 

.05 

Aff^-- 

46la  All  child  negative  affect 

06 

.  14 

.09 

26 

.05 

.17 

463a  All  negative  behavior 

o:. 

.27 

.05 

.29 

.05 

18 

.27 

.05 

594c  All  negative  behavior 

11 

.14 

.12 

29 

.05 

.19 

Child  Behavior 

467a  Child  cooperation 

20 

.05 

-.15 

-.01 

00 

-.06 

513c  Child  task  persistence 

09 

.32 

.05 

.12 

12 

.21 

574c  Child  movement 

12 

-.30 

.05 

-.18 

15 

-.23 

598c  Child  cooperation 

03 

-.42 

.01 

-.33 

,01 

26 

.05 

-.37 

.01 

Communication  Focus 

418a  Adults  attentive  to  children  non- 

academic 

22 

.05 

-.23 

-.06 

11 

-.15 

419a  Adults  attentive  to  children,  academic 

27 

.01 

.32 

.05 

.15 

18 

.24 

Child  focus  variables,  which  are  identified  by  :he  c  appearing  as  part  of  tht  variable  code  number, 
pertain  to  105  rather  than  108  classrooms. 
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Table  U2  (Concluded) 


PARTIAL  CORREUTIONS  OF  MAT  MATH  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  N*on-FolLow  Through) 


First 


Third  Grade  (N»58) 


Grade 

Math 

Math 

(N=108*) 

Computa- 

Math 

Problem 

Variables 

Total  Math 

tion 

Concepts 

Solving 

Totol  Math 

No .  Name 

r 

Commiinlcat ion  Focus  (Continued) 

A 38a  Adult  communication  or  attention 

focus  , 

one  child 

,19 

-.11 

-.30 

.05 

-.27  .C5 

-.23 

AAla  Adult  communication  or  atrencion 

f o^us , 

large  group 

.10 

.24 

.39 

.01 

.29  .05 

,32  ,05 

47la  Adults  attentive  to  large  group 

-.07 

.33 

.39 

.01 

.31  .05 

.36 

Miscellaneous 

A44a  Adult  movement 

.04 

.41  .01 

.39 

.0! 

.43  .001 

.44  .001 

*Child  foi.us  variables,  whkh  are  identified  by  Che  c  appearing  as  part  of  the  variable  code  number, 
pertain  to  i05  rather  than  108  classrooms. 
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third  gradti  subtests,  as  well  as  with  the  test  totals  for  first  and  chi^d 
grades.     A  variable  that  describer  the  number  of  children  involved  in 
math  (Var.  140)  on  all  of  the  observed  days  also  had  high  positive  cor- 
relations with^all  of  the  math  test  scores  in  both  grade  levels.  ''Total 
academic  verbal  interactions,"  which  is  a  variable  representing  discus^ 
sions  of  reading  or  math  (Var.  435a  and  566c)  only,  was  positively  re- 
lated to  math  scores  in  both  grades  and  these  correlations  occurred  in 
both  the  adult-focused  data  and  the  child-focused  data.    Thus,  opportun- 
ity and  exposure  to  math  seemeds  to  have  an  important  effect  upon  test 
performance* 

Since  the  average  amount  of  time  spent  in  arithmetic  was 
highly  correlated  with  achievement  in  math,  scattergrams  were  generated 
to  investigate  v>?hether  classrooms  that  had  a  lower  raean  score  on  the 
baseline  WRAT  performed  differently  in  relationship  to  this  process  vari- 
able and  math  achievement  than  those  classrooms  that  had  higher  class- 
room mean  scores  on  the  WRAT.     The  classroom  mean  scotes  were  rank 
ordered  and  divided  into  three  equal  groups  of  high,  medium,  and  low. 
In  first  grade  there  were  36  in  each  group  and  in  third  grade  there  were 
19  in  the  high  and  low  groups  and  ^0  in  Che  medium  group. 

In  both  first  and  third  grade,  the  classrooms  where  chil- 
dren entered  with  lower  baseline  scores  achieved  more  when  the  amount  of 
time  spent  in  math  increased  than  did  the  children  in  classrooms  with 
higher  baseline  scores  (see  Table   il3).     This  is  particularly  evident 
in  third  grade  (see  Figures  38,  39,  and  40)  where  the  correlation  ranges 
from  .65  for  classrooms  with  low  baseline  \JRAT  mean  scores  to  .26  for 
classrooms  with  high  WRAT  mean  scores.     This  finding  suggests  that  chil- 
dren who  entered  school  with  less  ability  need  more  time  spent  in  develop- 
ing basic  skills. 

In  third  grade  classrooms  where  children  were  taught  math 
in  large  groups  by  adults  (Var.  135),  children  performed  better  on  the 
math  tests  than  children  who  were  taught  in  other  grouping  arrangements. 
Because  of  the  instructions  given  to  classroom  observers  to  record  all 
;.;roups  of  over  eight  children  as  "large  groups,"  the  interpretation  of 
any  variable  which  includes  large  groups  is  confused.     It  could  be  that 
tb.ree  adults  were  instructing  separate  groups  of  ten  children  each,  or 
it  could  be  that  one  adult  was  instructing  one  group  of  30  children, 
with  two  aides  performing  classroom  management  tasks.     Since  Var.  107 
(Adults  with  large  group),  which  includes  teacher,  aide,  and  volunteers 
and  Var*  123  (Teacher  with  large  group)  both  had  positive  correlations 
with  the  test  scores  in  the  third  grade,  it  .could  be  that  several  large 
groups  of  nine  or  more  children  were  functioning  at  the  same  time  in  the 
classroom.    All  other  grouping  arrangements  (Var.  122,  133,  134,  136, 
137,  ^nd  138)  showed  either  negative  correlations  with  math  scores  or 
no  significant  relationship  with  test  scores. 

The  occurrence  of  reading  and  the  number  of  children  in-- 
volved  in  reading  were  related  to  math  scores.     This  relationship  sug- 
gests that  programs  that  stress  one  of  the  basic  skills  also  stress  the 
other  bpsic  skills. 
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Table  113 


AVERAGE  OCCURRENCE  OF  CHILDREN 
ENGAGED  IN  MAT!'  ACTIVITIES  PER  OBSERVATION'^  (VAR.  1) 


Low  Med  High 

First  Grade 

Number  of  Classrooms  36  36  36 

Correlations  ,51  *  05  .40 

Third  Grade 

Number  of  Classrooms  19  20  19 

Correlations  .65  .58  .25 


^Computed  over  three  days  and  includes  approximately  60 
observations. 


Many  question-response-feedback  variables  had  significant 
correlations  with  math  scores  in  both  grades.     In  this  type  of  interac- 
tion, an  adult  asks  the  children  a  direct  question  that  .requires  a  spe- 
cific response.     The  adult  then  gives  immediate  feedback  to  the  response 
so  that  the  child  knows  if  he  is  right  or  wrong. 

In  the  first  grade^  there  was  a  positive  correlation  with 
adult  questions  to  individual  children  in  academic  subjects  (Var.  354a). 
This  trend  reversed  in  the  third  grade  and  the  significant  relationship 
was  between  adults  questioning  groups  of  children  (Var.  353a)  rather  than 
an  individual  child.     Children  offering  academic  responses  and  extended 
responses  (Var.  360a  and  370a)  were  s:* gnif icantly  correlated  in  both  grades. 

A  change  in  the  effect  of  adult  feedback  upon  math  test 
scores  was  evident  in  the  correlations  for  the  two  grades.     For  academic 
activities  in  the  first  grade,  acknowledgment,  praise,  tokens,  positive 
corrective  and  neutral  corrective  feedback  (Var.  395a,  399a,  402a,  and 
449a)  were  significantly  related  to  math  scores.     In  the  third  grade, 
praise,  neutral  corrective  and  negative  corrective  feedback  (Var.  402a, 
407a,  and  449a)  had  significant  relationship  with  the  scores. 

The  positive  correlation  of  test  scores  with  negative 
corrective  feedback  in  academic  subjects  was  surprising.    This  feedback 
is  usually  in  the  form  of  demeaning  statements,  threats,  withholding 
privileges,  or  punishment.     It  is  difficult  to  understand  how  this  would 
motivate  the  child  to  perform  better  in  math.    Most  sponsors  encouraged 
teachers  to  be  supportive  and  to  redirect  incorrect  responses  in  academic 
situations. 
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It  is  interesting  to  note  that  the  use  of  tokens  as  re- 
inforcement (Var.  399a,  400a,  469a,  and  600c)  was  correlated  with  test 
scores  in  only  the  first  grade.    The  University  of  Kansas  model,  the 
only  model  to  use  tokens,  has  modified  its  program  in  the  third  grade 
and  recommends  verbal  reinforcement  rather  than  tokens.    This  difference 
in  procedure  between  first  and  third  grade  is  reflected  in  the  results. 

A  variable  describing  an  adult  moving  around  the  class- 
room (Var.  444a)  was  positively  correlated  with  all  subscores  on  the 
third  grade  math  tests.     This  movement  most  likely  occurred  as  the  teacher 
moved  around  the  classroom  assisting  children  in  checking  the  work  in 
the  workbooks  or  textbooks  and  providing  feedback.    Textbooks  and  work- 
books and  child  self-instruction  (Var.  240  and  509c)  were  also  positively 
correlated  with  math  computation. 

In  the  third  grade,  two  strange  positive  correlations  from 
the  child-focused  data  were  found  bet.;een  children  or  adults  not  respond- 
ing (Var.  544c,  545c)  and  the  math  scores.    This  is  likely  to  be  an  anom- 
aly caused  by  our  instructions  to  the  observer.    The  observer  was  in-- 
structed  to  record  an  adult's  question  to  the  group,  and  if  the  child 
being  observed  did  not  respond  either  in  chorus  or  individually,  he  would 
be  recorded  as  not  responding.     On  the  other  hand,  if  the  observed  focus 
child  *  as  requesting  assistance  and  had  his  hand  up,  the  teacher  was 
coded  as  not  responding  until  she  gave  that  particular  child  some  atten- 
tion.    Since  this  correlation  occurred  only  in  the  child-focused  data, 
we  conclude  that  it  is  an  anomaly,  reflecting  the  way  the  data  were  col- 
lected. 

In  the  first  grade,  there  were  49  significant  positive 
correlations  and  35  negative  correlations  with  components  of  the  more- 
structured  model  more  often  positively  related  to  the  test  scores.  Vari- 
ables relating  to  the  more  open  classrooms,  such  as  **Wide  variety  of 
activities"  and  child  independence,  were  negatively  correlated. 

In  general,  the  third  grade  subscores  correlated  very 
similarly:  math  computations  had  114  significant  correlations,  math 
concepts  104,  problem  solving  77,  and  ♦"otal  math  108.  Out  of  these, 
there  were  52  variables  on  which  they  had  ell  significant  correlations. 

Math  computation  had  more  significant  correlations  with 
all  of  the  stimulus-response-feedback  variables  than  did  the  other  two 
subtests.     Primarily,  this  subtest  correlates  positively  with  instruc- 
tional variables  which  represent  the  structured  model  and  negatively 
with  variables  representing  the  flexible  models. 

Only  math  concepts  had  significant  positive  relationships 
with  a  higher  ratio  of  adults  to  children  (Var.  15,  16).     It  also  was 
the  only  subtest  to  have  a  positive  relationship  with  the  occurrence  of 
social  studies  (Var.  68,  186).     Some  social  studies  projects  require 
building  models,  and  the  like,  which  may  aid  in  developing  math  concepts 
as  measured  by  the  MAT  subtest.  Math  Concepts. 
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Problem  solving  was  somewhat  different  in  its  correlations 
frcm  the  other  subtests.     Problem  solving  was  not  negatively  affected  by 
games  or  toys  used  or  group  time  (Var»  26  and  62)  as  were  the  other  sub- 
scores.     Nor  did  the  problem-solving  subscore  have  as  many  negative  cor- 
relations with  variables  associated  with  independence,  small  groips, 
personalized  instruction,  audiovisual  equipment  used,  or  exploratory  ma- 
terials as  did  the  other  two  subscores.    Also,  fewer  negative  correla*- 
tions  were  reported  between  problem  solving  and  open-ended  divergent-type 
questions  or  task-related  comments,  as  they  were  for  the  two  other  sub- 
scores.    The  only  positive  correlation  with  children  presenting  informa- 
tion to  a  group  (Var.  372a)  was  with  the  problem-solving  subtest.  Never- 
theless problem  solving  was  highly  correlated  with  the  other  subtests 
and  probably  is  measuring  very  similar  dimensions  of  math  ability. 

Overall  for  third  grade,  there  were  a  total  of  403  corre- 
lations p      ♦OS  when  correlations  of  all  tests  were  combined.    Of  these, 
165^Vvrere  positive  correlations  and  238  were  negative  correlations.  Thus, 
we  have  learned  as  much  regarding  what  instructional  processes  may  not  en 
hance  achievement  on  these  tests  as  we  have  learned  about  the  processes 
that  may  be  beneficial  to  student  performance.     Data  presented  on  Table 
114  indicate  that  in  the  fir^t  grade  the  University  of  Kansas  classrooms 
had  the  highest  raw  score  mean  as  well  as  the  highest  adjusted  score  rel- 
ative to  all  other  classrooms.     Surprisingly  EDC,  ^  sponsor  which  does 
not  emphasize  developing  basic  skills  in  the  first  grade,  had  the  second 
highest  adjusted  score.     This  score  was  even  higher  than  the  Non-Follow 
Through  score. 

In  third  grade.  University  of  Oregon  had  a  raw  score  and 
adjusted  score  in  math, which  were  significantly  different  from  all  other 
sponsors  and  Non-Follow  Through  (see  Table  114).     Compared  to  all  class- 
rooms. University  of  Kansas  and  Non-Follow  Through  were  the  only  other 
groups  to  have  positive  adjusted  math  scores. 

Excepting  EDO,  in  the  first  grade,  the  sponsors  who  ad — 
vocate  the  use  of  the  process  variables  which  are  positively  related  to 
math  scores  are  the  sponsors  which  had  higher  raw  scores  as  well  as 
higher  adjusted  math  scores.     EDC's  mean  scores  in  first  grade  on  the  use 
of  process  variables  that  were  positively  related  to  the  math  scores  vere 
lower  in  relationship  to  the  scores  of  University  of  Oregon,  University  o 
of  Kansas,  and  Non-Follow  Through  on  the  process  variables.     In  the  case 
of  EDC,  variables  other  than  those  we  have  assessed  in  this  report  must 
account  for  EDC's  residual  gain  score  in  math. 

b.      Reading  Correlations 

Correlations  were  computed  for  reading  test  scores  and  in- 
structional variables  (first  adjusting  for  baseline  WRAT  scores)*  Some 
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Table  li4 


SPONSOR  AND  NON-FOLLOW  THROUGH  MEANS  AND 
STANDARD  DEVIATIONS  FOR  MAT  TOTAL  MATH  SCORES 


Var.  438/Fall 
1971  WHAT 


Var.  443/ 
MAT  Math 
Raw  Score 


Relative  Differ- 
ence in  adjusted 
MAT  Math  Scores 
Among  Sponsors 
and  NFT 


Sponsor  and  Number  Mean 


Standard 
Deviation  Mean 


Standard 
Deviation  Mean 


Standard 
Deviation 


FIRST  GRADE 


Far  West  (N=12) 

32.65 

2. 

78 

31.  31 

5.  73 

-2 .  56 

6  •  01 

University  of  Arizona 
(N=14) 

30.92 

5. 

09 

31.08 

7.25 

-1.55 

6.14 

Bank.  Street  (N=ll) 

26.86 

5 

72 

29.  5A 

5 . 22 

4  .  3U 

University  of  Oregon 
(N=5) 

29.32 

7 

50 

31.  U 

7 . 25 

University  of  Kansas 
(N=17) 

28.11 

.68 

36.  76 

7.  50 

6.10 

7 . 36 

High/Scope  (N=13) 

26.60 

7 

.10 

2A .  2A 

7 . 03 

-5 .  3A 

5 . 66 

EDC  (N=12) 

27.02 

5 

.AO 

30.99 

A.  00 

1. 11 

1.67 

NFT  (N=24) 

32.67 

9 

.05 

3A.27 

9.99 

.38 

6.28 

THIRD 

GRADE 

Far  West  (N=1A) 

AO. 78 

3 

.31 

A9.62 

9.71 

-6.08 

8.65 

University  of  Arizona 
(N-2) 

28.20 

.28 

33.72 

7.  2A 

-12. 5A 

7.A5 

Bank.  Street  (N=7) 

32. A2 

6 

.78 

A7.A2 

12. A9 

-2.00 

8.A2 

University  of  Oregon 
(N=A) 

33.50 

6 

.37 

71.12 

9.32 

20.89 

8.13 

University  of  Kansas 
(N=12) 

35.16 

5 

.82 

52.63 

10.67 

1.15 

8.18 

High/Scope  (N=0) 

* 

* 

* 

* 

* 

EDC  (N=6) 

26.38 

6 

.95 

38.53 

11.56 

-6.36 

7.20 

NFT  (N=13) 

38.25 

8.71 

58.79 

11.96 

5.00 

1A.A3 

Insufficient  classrooms  were  both  tested  and  observed  in  the  third  grade 
for  High/Scope  for  their  model  to  be  included  in  the  analysis. 
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105  first  grade  and  58  third  grade  classrooms  were  included  in  the  anal- 
ysis (see  Table  101  for  the  classroom  and  site  breakdoi-m  by  sponsor)* 
Since  340  instructional  variables  were  used,  approximately  17  significant 
correlations  p  <  .05  for  each  test  could  be  expected  to  occur  by  chance. 
Those  variables  that  showed  significant  correlation  with  both  reading 
tests  in  a  single  grade  level,  or  were  significant  in  both  grade  levels, 
can  be  interpreted  with  greater  confidence. 

In  the  first  grade,  the  "word  analysis"  test  scores  were 
significantly  correlated  with  113  of  the  instructional  variables  and  118 
of  the  variables  correlated  with  the  score  on  the  "total  reading"  task. 
(Word  analysis  is  not  a  subset  of  the  total  reading  score.)     Out  of  these, 
88  variables  were  significantly  correlated  with  scores  from  both  tests. 

The  MAT  reading  test  administered  to  the  third  grade 
measured  "language"  and  "total  reading."    Of  the  instructional  variables, 
91  were  significantly  correlated  with  the  "language"  test  scores,  and  63 
variables  were  significantly  correlated  with  "total  reading."    Of  these, 
46  variables  were  common  to  the  two  tests. 

The  amount  of  time  spent  in  school  (Var.  17)  had  a  posi- 
tive significant  relationship  with  all  scores  in  both  grades  (see  Table 
115).    There  v>^as  a  difference  among  sites  of  2  hours  in  the  total  class 
duration.    Not  only  did  the  amount  of  time  in  school  affect  scores,  but 
also  the  amount  of  time  spent  in  reading.    Two  variables  in  the  first 
grade  were  positively  correlated  with  opportunity  or  exposure  t^  reading 
(Var.  67,  163).    The  number  of  children  involved  in  math  or  social 
studies  (subjects  requiring  reading  skills  in  the  third  grade)  was  posi- 
tively related  to  reading  scores  in  the  third  grade.    Another  variable, 
which  described  interactions  taking  place  between  adults  and  students 
involved  with  reading  or  math,  was  related  to  high  reading  scores  in  both 
grades  (Var.  435a,  566c).    These  significant  positive  relationships  oc- 
curred in  both  the  child-focused  and  the  adult-focused  data.    The  re- 
sults for  the  preceding  variables  combined  suggest  that  more  opportun- 
ities and  exposure?  to  reading  will  enhance  reading  scores. 

The  results  also  indicate  differences  in  v/hat  appear  to 
be  optimal  grouping  arrangements  for  the  first  and  the  third  grade. 
First  grade  scores  were  higher  when  adults  worked  with  small  groups  (Var. 
88,  149,  157).     Third  grade  scores  were  higher  when  the  adults  worked 
with  large  groups  (Var.  89,  107,  146,  158).     Small  groups  have  been  de- 
fined as  a  group  of  3  to  8  children.     Thus,  any  group  of  9  or  more  chil- 
dren v>^as  classified  as  a  large  group.     The  sponsors  often  have  fewer 
aides  assigned  at  third  grade  than  first  grade;  thus,  with  fewer  adults, 
the  group  size  would  naturally  be  larger  and  would  probably  be  coded  as 
a  large  group.     Also  Non-Follow  Through  classrooms  are  most  likely  to  be 
taught  in  large  groups  since  they  do  not  often  have  classroom  aides 
available.     Two  variables  relating  to  the  number  of  children  per  adult 
(Var.  15,  16)  were  positively  related  to  third  grade  reading  and  language 
scores.    Apparently  when  there  were  fewer  adults  per  child,  the  scores 
were  higher.     Since  large  groups  dominate  in  the  third  grade,  these  cor- 
relations are  to  be  expected* 
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Table  115 


PARTIAL  CORREUTIONS  OF  MAT  READING  SCORES  WITH  INSTRUCTIONA!.  VARIA%ES 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


First  Grade  (N=108*)         Third  Grade  (N°58) 
Word  Total  Total 


Variables 

Analysis 

Reading 

Language 

Read  ing 

No. 

Name 

r 

r 

r 

r 

MATERIALS 

25 

Games,  toys,  play  equipment  present 

- 

23 

.05 

-.32 

.001 

-.29 

.05 

- 

.29 

.05 

26 

Games,  toys,  play  equipment  used 

- 

08 

-.20 

.05 

-.31 

.05 

- 

.32 

.05 

28 

Instructional  materials  used 

23 

.05 

.16 

-.11 

.11 

38 

Audio  visual  equipment  used 

- 

15 

-.28 

.01 

-.10 

- 

.06 

44 

Total  number  different  resource  categories 

coded  "present"  over  three  days 

- 

08 

-.19 

.05 

-.23 

- 

.18 

237 

Audio  visual  equipment/Academic  Activities 

- 

25 

.01 

-.29 

.01 

-.15 

- 

.12 

238 

Exploratory  materials/Academic  Activities 

- 

09 

-.15 

-.26 

.05 

- 

.15 

239 

Math  or  science  equipment/Academic 

Activities 

- 

04 

-.07 

-.31 

.05 

- 

.36 

.01 

240 

Texts,  workbooks/Academic  Activities 

16 

.24 

.01 

.13 

.11 

241 

Puzzles,  games/Academic  Activities 

- 

04 

-.09 

-.34 

.01 

- 

.17 

ACTIVITIF.S 

22 

Teacher  assigns  chil'lren  to  groups 

20 

.  05 

24 

Child  selection  of  seating  and  work  groups 

20 

26 

.01 

30 

.05 

.23 

62 

Group  time 

30 

-.22 

.  05 

-.23 

90 

63 

Story,  music,  dancing 

16 

.  01 

-.13 

-.  39 

.01 

.  20 

64 

Arts,  crafts 

29 

.01 

-  _  26 

.  01 

-.03 

.  03 

65 

Guessing  games,  table  games,  puzzles 

12 

-.10 

-.27 

.05 

1 7 

66 

Numbers,  mnth  nrirhmprlr 

26 

.  01 

.  19 

.  05 

.  21 

.  33 

.  01 

67 

Reading,  alphabet,  language  development 

38 

.  001 

.  40 

.  001 

.  23 

Oft 

68 

Social  studies,  geography 

20 

.  05 

.  29 

.01 

.  28 

.  05 

.  17 

69 

Science,  natural  world 

18 

-.  24 

.01 

-.10 

.06 

71 

Blocks,  trucks 

23 

.  05 

-.  24 

.  \}j 

-  "XCs 

.  j\j 

.  \jj 

- 

.32 

.05 

73 

Active  play 

- 

21 

.05 

-.23 

.05 

-.10 

.01 

76 

Social  interaction 

01 

-.08 

.35 

.01 

.19 

77 

Unoccupied  child 

_ 

18 

-.11 

.30 

.05 

.26 

78 

Discipl ine 

- 

19 

-.20 

.05 

-.00 

.  io 

80 

Class/oom  management 

Z.  £. 

.  Uj 

- .  Z  J 

.  U  J 

—  .  1  / 

.U/ 

82 

Wide  variety  of  activities,  concurrent 

1  A 
1  o 

_    1  Q 

AH 

— .  mj 

n  1 
.  Ul 

.  33 

.  U3 

83 

Wide  variety  ot  activities,  over  one  day 

n  I 
.  Ui 

- .  JU 

n  1 

- .  JO 

c\  1 
.  Ul 

.  20 

84 

Approximate  number  of  children  in  the 

classroom  in  any  activity 

24 

0  7 

.  U  J 

.  1  J 

244 

Group  time/Longitudinal 

28 

.  01 

-   9  1 

.  \)j 

.  12 

245 

Story,  music,  dancing/Longitudinal 

1  J 

1  c 
-  .  i  J 

- .  ^U 

.  Ul 

. 

246 

Arts,  crafts/Longitudinal 

.  UUJL 

-  .  J  J 

.  UUi 

— .  z  / 

.  U  J 

- 

.18 

250 

Social  studied,  geography/Longitudinal 

15 

.23 

.05 

.14 

252 

Sewing,  cooking,  pounding/Longitudinal 

X  K 

-.08 

-.31 

.01 

.18 

253 

Blocks,  trucks/Longitudinal 

18 

-.18 

.27 

.05 

.34 

.01 

255 

^  !ve  play/Longitudinal 

20 

.05 

-.15 

-  13 

.07 

d65c 

jitic  play,  pretending 

20 

.05 

■'.20 

.05 

-.25 

.23 

TIME 

SPi-NT  AND  ACADEMIC  INTERACTION 

17 

Total  class  duration 

29 

.01 

30 

.01 

,35 

.01 

29 

.03 

140 

Approximate  number  of  children  involved  in 

Math,  all  days  observed 

29 

.01 

.22 

.05 

.28 

.05 

31 

.05 

163 

Approxi.nate  number  of  children  involved  in 

Reading,  all  days  observed 

30 

.001 

.40 

.001 

.32 

.05 

18 

186 

Approximate  number  of  children  involved  in 

Social  Studies,  all  days  observed 

20 

.05 

.11 

.01 

.26 

10 

207 

Approximate  nunber  uf  children  involved  in 

Science — all  days  observed 

11 

-.20 

.05 

-.06 

04 

Child  focus  variables,  which  are  identified  by  the  c  appearing  as  part  ot  the  variable  code  number, 
pertain  to  105  rather  than  108  classrooms. 
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Table  115  (Continued) 


PARTIAL  CORRELATIONS  OF  MAT  READING  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  Non-FoUow  Through) 


First  Grade  (N'»108*)         Third  Grade  (N»58) 


Variables 


No. 


Name 


Word 
Analysis 


Total 
Read  in^ 


Total 

Language        Read  ing 
JE±-  _i_ 


TIME  SPENT  AND  ACADEMIC  INTERACTION  (Continued) 


228      Approximate  number  of  children  involved  In 

Arts    Arts  and  Crafts,  all  days  observed 

242      Percent  CCLs  In  which  on  academic  activity 

Is  occurring 

435a    Total  academic  verbal  interactions 

566c    Total  academic  verbal  interactions 

GROUPINGS 


22 

.05 

-.20 

.05 

.07 

.02 

35 

.001 

.26 

.01 

.42 

.01 

.25 

42 

.001 

.33 

.001 

.29 

.05 

.29 

.05 

55 

.001 

.50 

.001 

-.23 

.34  ' 

.01 

Adults  in  the  Classroom 


15  Child/teacher  aiid  aldo  ratio  (Number  of 

children  over  teachers  and  aides)  .02  ,11  .47     .001      .50  .001 

16  Child/adult  ratio  (Number  of  children  over 

teachers,  aides,  and  volunteers)  -.03  .04  .46  .44  .OOJ 

96      Overall  aide  occurrences  .18  .11  -.20  -.28  .05 

262      Average  number  of  adults  in  the  classroom/ 

Longitudinal  .14  .11  .31     .05      -.29  .05 


Adults  Without  Children 


85      Teacher  without  children  -.24  .01      -.26  .01      -.14  .04 

229      Teacher  Involved/Classroom  Management  -.15  -.25  .01      -.41  .02 

231      Volunteer  involved /Classroom  hianagement  .08  .00  .20  .28  .05 

Individualized  Attention 


86 

Teacher  with  one  child 

-.31 

.01 

34 

.001 

-.12 

-.12 

92 

Aide  with  one  '^hild 

-.06 

22 

.05 

-.08 

-.15 

104 

Adult  with  one  child 

-.23 

.05 

30 

.01 

-.15 

-.14 

109 

One  child  with  any  adult 

-.26 

.01 

33 

.001 

-.16 

-.14 

124 

One  child  with  aide/Math 

-.16 

22 

.05 

-.16 

-.23 

141 

Personalized  Instruction  in  Math 

-.20 

.05 

25 

^1 

-.20 

-  22 

143 

One  child  with  teacher/Reading 

-.31 

.01 

31 

.01 

-.23 

-.20 

155 

One  child  with  any  adults/Reading 

-.27 

.01 

32 

.001 

-.24 

-.21 

164 

Personalized  instruction  in  reading 

-.29 

.01 

34 

.001 

-.29  .05 

-.24 

257 

Teacher  with  one  child,  academic 

ac t ivi ties/Longi  tudlnal 

-.26 

.01 

28 

.01 

-.13 

-.18 

261 

Any  adult  with  one  child,  any  activity/ 

Longitudinal 

-.24 

.05 

30 

.01 

-.08 

-.06 

Adults  with  Two  Children 


87 

Teacher  with  two  children 

-.30 

.01 

-.29 

.01 

-.36 

.01 

-.37 

.01 

93 

Aide  with  two  children 

-.17 

-.19 

.05 

-.14 

-.10 

105 

Adult  with  two  children 

-.18 

-.17 

-.27 

-.27 

.05 

JIO 

Two  children  with  any  adult 

-.18 

-.21 

.05 

-.21 

-.16 

121 

Two  children  with  teacher/Math 

-.31 

.001 

-.25 

.01 

-.26 

-.21 

133 

Two  children  with  any  adults/Math 

-.22 

.05 

-.23 

.05 

-.21 

-.23 

144 

Two  children  with  teacher/Reading 

-.29 

.01 

-.32 

.001 

-.30 

.05 

-.29 

.05 

156 

Two  children  with  any  adults/Reading 

-.19 

.05 

-.22 

.05 

-.28 

.05 

-.23 

Child  focus  variables,  which  are  identified  by  the  c  appearing  as  part  of  the  variable  code  number, 
pertain  to  105  rather  Chan  108  classrooms. 
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Table  115  (Continued) 


PARTIAL  CORREUTIONS  OF  MAT  READING  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  Noa-Follow  Through) 


 Variables 

No .  Name 


Adults  with  Small  Group 

88  Teacher  with  small  group 

94  Aide  with  small  group 

106  Adult  with  small  group 

111  Small  group  of  children  with  any  adult 

122  Small  group  with  teacher/Math 

126  Small  group  with  aide/Math 

13A  Small  group  with  any  adults/Math 

IA5  Small  group  with  teacher/Reading 

149  Small  group  with  aide/Reading 

157  Small  group  with  any  adults/Reading 

201  Small  group  with  any  adults/Science 

222  Small  group  of  children  with  any  adults/ 
Arts  and  Crafts 


First  Grade  (N»108*)         Third  Grade  (N»58) 


Word  Math  Total 

Analysis        Read ing         I  anguage  Reading 


r 

r 

r 

.22 

.05 

.23 

.05 

-.35 

.01 

-.39 

.01 

.12 

.09 

-.34 

.Oi 

-.39 

.01 

.19 

.05 

.19 

.05 

-.36 

.01 

-.42 

.01 

.19 

.15 

-.33 

.01 

-.41 

.01 

-.10 

-.05 

-.31 

.05 

-.22 

-.02 

-.04 

-.24 

-.31 

.05 

-.08 

-.09 

-.36 

.01 

-.40 

.01 

.06 

.03 

-.35 

.01 

'  .41 

.01 

.26 

.01 

.22 

.05 

-.32 

.05 

39 

.01 

.21 

.05 

.17 

-.36 

.01 

-.4Z 

.01 

-.03 

-.12 

-.29 

.05 

-.28 

.05 

.07 

.05 

-.27 

.05 

-.21 

Adults  with  Large  Group 


89 

Teacher  with  large  group 

.13 

.15 

.54 

.001 

.49 

.001 

107 

Adult  with  large  group 

.06 

.11 

.53 

.001 

.46 

.001 

112 

Large  group  of  children  with  any  adult 

.04 

.09 

.48 

.001 

.43 

.001 

123 

Large  group  witii  teacher/Math 

.18 

.11 

.57 

.001 

.50 

.001 

127 

Large  group  with  aide/Math 

.26 

.01 

.29 

.01 

.02 

.04 

135 

Large  group  with  any  adul'-s/Math 

.31 

.01 

.27 

.01 

.55 

.001 

.51 

.001 

146 

Large  group  with  teacher/Reading 

.05 

.10 

.50 

.001 

.44 

.001 

158 

Large  group  with  any  adults/Reading 

.01 

.06 

.46 

.001 

.40 

.01 

181 

Large  group  with  any  adults/Social 

Studies 

.20 

.05 

.31 

.01 

.21 

.24 

223 

Large  group  of  children  with  any  adults/ 

Arts  and  Crafts 

.13 

.17 

.23 

.26 

.05 

Independent  Children 


114 

One  child  independent 

-.13 

-.20 

.05 

25 

-.14 

115 

Two  children  independent 

-.20 

.05 

-.28 

.01 

32 

,05 

-.24 

116 

Small  group  of  children  independent 

-.31 

.01 

-.30 

,01 

33 

,01 

-.17 

118 

All  children  independent 

-,30 

.01 

-.29 

.01 

16 

-.00 

136 

One  child  independent/Math 

-.12 

-.14 

32 

.05 

-.19 

'37 

Two  children  independent/Math 

-.23 

.05 

-.18 

38 

.01 

-.24 

138 

Small  group  of  children  ^ndependent/Math 

-.22 

.05 

-.18 

41 

.01 

-.26 

142 

All  children  independent/Math 

-.25 

.01 

-.20 

.05 

34 

.01 

-.21 

159 

One  child  independent/Reading 

-.17 

-.22 

.05 

34 

.01 

-.21 

160 

Two  children  indepandent/Reading 

-.19 

-.26 

.01 

32 

.01 

-.20 

161 

Snail  group  of  children  independent/ 

Reading 

.20 

.05 

-.19 

.05 

23 

-.10 

162 

Large  group  of  children  independent/ 

Reading 

.02 

.07 

26 

.05 

.28 

165 

All  children  independent/ Read ing 

-.22 

.05 

-.21 

,05 

10 

.05 

185 

Large  group  of  children  independnet/Social 

Studies 

-.25 

.01 

-.14 

.01 

.10 

203 

One  child  independent/Science 

-.31 

.01 

-.i7 

25 

-.16 

205 

Small  group  of  children  independent/ 

Science 

-.16 

-.21 

.05 

21 

-.14 

Miscellaneous 

113      Overall  occurrence  of  children  with  any 
adult 

*Chlld  focus  variables,  which  are  identified  by 
pertain  to  105  rather  than  108  classrooms. 


.30     .01        .29     .01        .16    .  .00 
c  appearing  as  part  of  the  variable  code  number, 
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lable  115  (Continued) 


PARTIAL  CORRELATIONS  OF  MAT  READING  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  AN'D  THIRD  GRADES 
(Follou  Throagh  and  Non-FoUow  Through) 


Variables 


No. 


First  Grade  (N=I08*) 

Word  Total 
Analysis        Read  ing 


Name 


Third  Grade  (N^58) 
Total 
Languai^t  Rea.*ing 


IN'!  ERACTIONS 


Chi  Id  Quest  ion ing 


346a    Child  commands,  requests,  and  direct 


quest  ions ,  nonacademic 

-.23 

.05 

-,27 

.01 

-.33 

.01 

-.31 

.05 

J49a 

Child  open-ended  questions,  academic 

-.22 

.05 

-,20 

.05 

-.26 

-.24 

350a 

Child  questions  to  adults 

-.11 

-.23 

.05 

-.24 

-.16 

450a 

All  child  open-ended  questions 

-.25 

,01 

-.17 

-.29 

,05 

-.23 

477c 

Child  commands,  requests,  and  direct 

quest  ions .  nonacademic 

-.33 

,001 

-.37 

.001 

-.33 

.01 

-.27 

,05 

479c 

Child  open-ended  questions,  nonacademic 

-.28 

.01 

-.15 

-.07 

-.09 

581c 

All  child  open-ended  questions 

-.29 

.01 

-,17 

-.07 

-.06 

Adult  Questioning 

352a    Adult  commands,  requests,  and  direct 

questions  to  individual  children,  non- 


academic 

-,25 

.01 

-.20 

.05 

-,37 

.01 

-.29 

353a 

Adult  commands,  requests,  and  direct 
questions  to  groups  of  children. 

academic 

.29 

.01 

.20 

.05 

.51 

.001 

.32 

355a 

Adult  open-ended  questions  to  children. 

nonacademic 

-,20 

.05 

-.13 

-.36 

.01 

-.24 

357a 

All  adult  questions  to  children 

.25 

.01 

.  19 

.15 

.06 

451a 

Adult  academic  commands,  requests,  and 

direct  questions  to  children 

.35 

.001 

.26 

.01 

.30 

.05 

.18 

452a 

Adult  open-ended  questions  to  children 

-.11 

-.08 

-.31 

.05 

-.13 

483c    Adult  commands,  requests,  and  direct 
questions  to  individual  children. 


academic 

.29 

.01 

,22 

.05 

.01 

.10 

All  adult  questions  to  children 

.37 

.001 

.28 

.01 

.31 

.05 

.24 

Adult  academic  commands,  requests,  and 

direct  questions  to  children 

,44 

,001 

,35 

.001 

.35 

.01 

.30  .05 

Child  Responsiveness 


358a    All  child  responses 

359a    Child  responses,  nonacademic 

360a    Child  responses,  academic 

362a    One  child  responds  to  adult  academic 

commands,  requests,  or  direct  questions 
363a    Child  group  responses  to  adult  academic 

commands,  requests,  or  direct  questions 
368n    Child  responses  to  adult  open-ended 

quest  ions 

370a    Child  extended  response,  academic 

490c    Child  reoponses,  nonacademic 

491c    Child  responses,,  academic 

49 3o    One  child  responds  to  adult  academic 

commands,  requests,  or  direct  questions 
544c    Child  not  responding  to  adults 


28 

.01 

,28 

.01 

.17 

.05 

19 

.05 

-.  12 

-.30 

.05 

-,28 

,05 

38 

.001 

,33 

,01 

,25 

,15 

23 

,05 

,21 

,05 

.02 

-.01 

j)2 

,001 

,22 

,05 

.45 

.001 

.34 

.01 

11 

-.08 

-.27 

.05 

-.08 

17 

.21 

.05 

.08 

,27 

.05 

22 

.05 

-.25 

,01 

-.14 

-.05 

41 

.001 

.35 

.001 

,17 

.20 

24 

.05 

,17 

-.17 

-.06 

13 

.11 

,48 

.001 

.24 

Child  fucus  variables,  which  are  identified  by  the  c  appearing  as  part  of  the  variable  code  number, 
pertain  to  105  rathir  than  108  classrooms. 
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Table  115  (Continued) 


PARTIAL  COKRKI^MIONS  OF  MAI  RhADING  SCORES  WITH  INSTRUCTIONAL  VARIABLES 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  Non-Follow  Through) 


First  Grade  (N^'IOS*)  Third  Grade  (N«58) 

Word             Total  Total 

V<i  r  1  a  b  1  e  s  Analysis        Reading  Language  Reading 

nT:  ~         "Nomo   _r          p<      _r          P<      _S          P<    ..P.^, 


Adult  Responsiveness 


365a    Adult  responses  to  child  requests  or 

questions,  nonacademic  -.26     .01      -.33     .001    -.31  -.17 

496c    Adult  responses  to  child  requests  or 

questions,  nonacademic  --27     .01      -.28     ,01      -.36     .01  -.26 

545c    Adult  not  responding  to  child  -.01  -.09  .36     .01        .28  .05 


Adult  Feedback 


394a 

All  adult  acknowledgment  to  children 

.28 

.01 

.18 

-.05 

-.16 

395a 

Adult  acknowledgment  to  children,  academic 

.34 

.001 

.23 

.05 

.04 

-.05 

A  1  )     \t}iy  1  ^    r> m  i  CP    1 ^^•}^  1  1  ri  rt>n 

.  36 

.001 

.01 

.04 

-  .01 

J7  7a 

Al')ll1^    V  f*  i  r\  f  nr  r  f*mf*nt'   uf^'h    rnkt*n  nrnfJpmit'" 
/\uuXL                       drill  diL    wiwii    cx^rw^ti,    <i^<iui^  til 

.  29 

.01 

.  28 

.01 

-.12 

.06 

400a 

ArUi  1  t    rt»  i  n  f  r>rr  (>m<>n  r   with    ftikpn  behavior 

.  26 

.  31 

.01 

.01 

.08 

401d 

Adult  reinforcement  with  token,  other 

tdsk-relaled 

.27 

.01 

.40 

.001 

-.11 

.04 

402a 

Adult  praise,  academic 

.33 

.001 

.28 

.01 

.13 

.10 

403a 

Adult  praise,  behavior 

.24 

.01 

.27 

.01 

.04 

.10 

404a 

Adult  praise,  other  task-related 

.12 

.08 

-.26 

-.33 

406a 

Adulr  positive  corrective  feedback. 

academic 

.20 

.05 

.21 

.05 

.08 

.08 

407a 

Adult  negative  corrective  feedback. 

academic 

.16 

.05 

.30 

.05 

.15 

410a 

Adult  positive  corrective  feedback,  other 

task-related 

-.20 

.05 

-.07 

.04 

-.21 

412a 

Adult  feedback  to  child  responses  to  adult 
academic  commands,  requests,  and  direct 

questions 

.46 

.001 

.39 

.001 

.07 

-.05 

432a 

Adult  punishment  of  children 

.02 

-.08 

.39 

.01 

.23 

448a 

Adult  neutral  corrective  feedback. 

behav lor 

-.23 

.05 

-.16 

.19 

.05 

449a 

Adult  neutral  corrective  feedback. 

academic 

.15 

.23 

.05 

.10 

.07 

469a 

All  adult  reinforcement  with  tokens 

.31 

.001 

.31 

.001 

-.11 

.06 

54  3c 

Adult  feedback  to  child  responses  to  adult 
academic  commands,  requests,  and  direct 

questions 

.39 

.001 

.28 

.01 

-.09 

-.04 

578c 

Adult  neutral  corrective  feedback,  task- 

related 

-.34 

.001 

-.19 

.02 

-.22 

579c 

Adult  neutral  corrective  feedback. 

behavior 

-.28 

.01 

-.21 

.05 

.11 

.02 

600c 

All  adult  reinforcement  with  tokens 

.29 

.01 

.28 

.01 

-.14 

.05 

Instruct  ion 


374a 

Adult  instruction,  academic 

,16 

.  11 

.09 

.29 

375a 

Adult  instructs  an  individual  child 

-.07 

-.03 

-.29 

.01 

-.24 

380a 

Child  self-instruction,  academic,  uith 

objects 

-.09 

-.02 

.29 

.05 

-.01 

455a 

All  adult  instruction 

.05 

.21 

.05 

-.14 

-.00 

468a 

Child  self-instruction,  nonacademic 

-.10 

-.10 

-.21 

-.28 

506c 

Adult  instructs  an  individual  child 

.03 

.09 

-.29 

.05 

-.22 

508c 

Child  self-instruction 

.29 

.01 

.29 

.01 

.03 

.17 

509c 

Child  self-instruction,  academic 

.42 

.001 

.40 

.001 

.08 

.24 

510c 

Child  self-instruction,  objects 

-.19 

.05 

-.22 

.05 

-.04 

-.08 

.05 


*Chi Id  focus  variables,  whiih  are  identified  by  the  c  appearing  as  part  of  the  variable  code  number, 
pertain  to  105  rather  than  108  classrooms. 


296 


Table  115  (Concluded) 

PARTIAL  CORREUTION'S  OF  MAT  READING  SCORES  ^ITH  INSTRUCTIONAL  VARIABLES 
FIRST  AND  THIRD  GRADES 
(Follow  Through  and  Non-FoUow  Through) 


 Vv.riables 

NVl-   .   Name 


Inst ruct  ton  (Continued) 

586c    All  adult  instruction 

599c    Child  self-instruction,  nonacademic 

Child  AttendinR 

577c    Child  attentive  to  machine 

Conversational  Statements 

2  32  Among  adults/Social  Interaction 

234  Among  children/Social  Interaction 

343a  Child  to  adult,  ail  verbal  except  response 

344a  Individual  child  verbal  Interactions  with 
adult 

387a  Child  general  comments  to  adults 

474c  Child  to  adult,  all  verbal  except  response 

476c  Verbal  interactions  among  children 

316c  Social  interaction  among  childre.^ 

517c  Child  task-related  comments  to  children 

518c  Child  general  comments  to  adults 

522c  Child  acknowledgment 

523c  Child  praise 

Affect 

591c    All  child  positive  affect 

592c     All  child  negative  affect 

594c    All  negative  behavior 

Child  Behavior 

75  Obs«?erving  (independent  children  only) 

513c  Child  task  persistence 

573c  All  child  nonverbal 

574o  Child  movemerit 

598o  Child  cooperation 

Communication  Focus 

419a    Adults  attentive  to  children,  academic 
438a    Adult  con^unlcat Ion  or  attention  focus, 
one  child 

441a    Adult  comiTiunication  or  attention  focus, 

large  group 
471a    Adults  attentive  to  lar^e  group 

Miscel laneQus 

444a    Adult  movement 


Child  focus  variables,  which  are  identified  by 
percaln  co  105  rather  than  108  classrooms. 


First  Grade  (N«108*)         Third  Graue  (N^58) 


Word  Total  Total 

Analysis       Reading         Language  Reading 


r 

r 

r 

r 

.06 

.  12 

.28 

.  28 

-.21 

.05 

-.  18 

14 

-.  22 

-.22 

.05 

-.25 

.01 

-.10 

-.28 

.03 

-.23 

.05 

_ ,  06 

.09 

.  29 

-.  13 

-  .21 

.05 

.  32 

.01 

.  22 

-.20 

.05 

-.24 

.01 

-.29 

.05 

-.21 

-.02 

.01 

-.34 

.01 

-.36 

.01 

-.29 

.01 

-.26 

.01 

-.27 

.05 

-.30 

.05 

- .  18 

-.  18 

- .  14 

-.  26 

.05 

- .  22 

.05 

.  01 

-.  26 

- .  25 

_  3Q 

- .  33 

.01 

- .  22 

- .  02 

-  riA 
,  uo 

- .  27 

—    1  Q 

-.26 

.01 

-.25 

.01 

-.27 

.05 

-.37 

.01 

.12 

.01 

-.21 

-  28 

.05 

-.25 

.01 

-.17 

-.07 

-.09 

-.20 

.05 

-.18 

.04 

.05 

-.14 

-.22 

.05 

.22 

.06 

-.11 

.  iO 

97 

97 

.  U  J 

-.05 

-.21 

.05 

-.03 

-.01 

.  28 

.  30 

m 

•  Ui 

.  07 

.  19 

.20 

.05 

.12 

.14 

.21 

-.12 

-.24 

.01 

-.11 

-.12 

-.03 

-.12 

-.26 

.05 

-.14 

.27 

.01 

.21 

.05 

.23 

.25 

.06 

.06 

-.39 

.01 

-.35 

.01 

»09 

.11 

.52 

.001 

.48 

.001 

-.01 

.02 

.56 

.001 

.45 

.001 

.04 

.03 

.51 

.001 

.43 

.001 

c  appearing  as  part  of  the  variable  code  number. 
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Instructional  patterns  differ  sr  .ewhat  for  grades  one  and 
three.    The  variable  **adults  asking  direct  qu  ocions  about  the  subject 
matter**  was  positively  related  to  all  reading  scores  for  both  levels,  as 
was  the  group  response  to  such  questions  (Var.  353a,  363a).  However, 
feedback  of  many  varieties  seemed  to  enhance  the  scores  in  first  grade. 
Acknowledgment,  praise,  tokens,  and  positive  corrective  feedback  (Var, 
395a,  399a,  402a,  and  A06a)  showed  significant  positive  correlations  with 
test  scores.    Reinforcement  used  for  academic  activities"  in  third  grade 
was  a  little  less  clear.     Reading  scores  had  a  negative  relationship 
(-.33)  with  praise  (Var.  404a)  given  ill  other  task-related  activities. 
This  is  similar  to  a  finding  of  Brophe  (1974).     He  found  that  praise  was 
negatively  related  to  achievement  gain  in  a  2~year  study  of  teacher  ef- 
fectiveness.   These  data  indicate  that  children  in  the  first  grade  need 
more  feedback  to  perform  well  than  do  children  in  the  third  grade.  Only 
language  scores  were  positively  related  to  two  feedback  variables  (Var. 
407a  and  432).    Th.se  data  suggest  that  if  children  in  classrooms  were 
given  negative  corrective  feedback  or  were  punished,  they  received  high 
scores  on  the  language  tests  (Var.  407a,  432a).     (The  incidence  of  pun- 
ishment was  very  low  for  all  sponsors,  and  thus  the  correlations  may  have 
reflected  anomalies  in  the  data.)    However,  Harris  (1968)  in  a  study  of 
48  elementary  school  teachers  also  found  a  positive  correlation  between 
criticism  or  negative  motivations  and  reading  achievement.     It  may  be 
that  some  groups  of  children  perform  better  when  these  firm  and  even 
negative  control  and  feedback  systems  are  used. 

First  grade  children  who  were  more  often  observed  to  be 
instructing  themselves  in  academic  subjects  also  scored  higher  on  tests. 
This  correlation  did  not  occur  in  the  third  grade. 

The  third  grade  had  higher  reading  scores  when  the  adults 
instructed  them  more  often  and  moved  around  the  room  (Var.  444a,  586c). 
The  adults  in  the  classroom  might  have  been  moving  around  their  group  of 
niua  or  more  children,  instructing  and  asking  questions  about  the  subject 
matter. 

As  we  have  seen  in  both  first  and  third  grades,  in  class- 
rooms where  more  time  was  devoted  to  academic  subjects,  and  where  the  in- 
teractions were  of  an  academic  nature,  the  children's  scores  on  MAT  read- 
ing tests  were  higher.     On  the  other  hand,  in  classrooms  where  a  large 
portion  of  children's  interactions  were  social  or  nonacademic  interactions, 
including  general  comments  to  adults  (Var.  234,  352a,  387a,  and  518c), 
the  reading  scores  were  lower. 

When  a  wide  variety  of  materials  were  available  or  when  a 
wide  variety  Qf  activities  occurred  over  the  day  (Var.  25,  71,  and  83), 
a  negative  correlation  with  reading  scores  was  indicated  for  both  grades. 
Perhaps  the  more  frequent  occurrences  of  nonc.i- ^demic  activities,  such  as 
arts  and  crafts,  music,  dance,  active  play  oi  group  time,  whi^h  showed 
negative  correlations,  did  not  allow  sufficient  time  to  develop  the  ne- 
cessary skills  to  score  well  on  the  reading  test  (Var.  63,  228,  244,  246). 
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Table  116 


SPONSOR  AND  NON-FOLLOW  THROUGH  MEANS  AND 
STANDARD  DEVIATIONS  FOR  MAX  READING  SCORES 


Var.  438/Fall 
1971  WHAT 


Sponsor  and  Number  Mean 


Standard 
Deviation 


Var.  ULZi 
MAT  Reading 
Raw  Score 


Mean 


Standard 
Deviation  Mean 


Relative  Differ- 
ence in  adjusted 
MAT  Reading 
Scores  Among 
Sponsors  and  NFT 
Standard 
Deviation 


FIRST  GRADE 


Far  West  (N=»12) 

32,65 

2.78 

40.81 

7.16 

-5.30 

7.30 

University  of  Arizona 

^  no 

Q    O  Q 

0  .  3d 

-1 . 55 

5.48 

Bank  Street  (N=ll) 

26.86 

5.72 

36.29 

7.18 

-2.53 

2.49 

University  of  Oregon 
(N-5) 

29.32 

7.50 

48.61 

9.94 

6.93 

3.19 

University  of  Kansas 

/'Mas!  7^ 

.11 

4  .  Do 

/.A  1  T 

y .  ij 

J  .  00 

y .  15 

nlgn/oCOpe    ^N— 1 

ZD  .  OU 

7 .  iO 

36 .  00 

0.  53 

-2 . 52 

6 . 24 

EDC  (N^ia) 

11  .^1 

5.40 

34.42 

6.60 

-4.58 

4.48 

NFT  (N-24) 

9.05 
THIRD 

48.34 
GRADb 

14.02 

2.77 

7.73 

Far  West  (N=14) 

AO. 78 

3.31 

47.20 

8.40 

-1.78 

6.87 

University  of  Arizona 
(N»2) 

28.20 

.28 

32.95 

2.05 

-3.83 

1.78 

Bank  Street  (N=7) 

32. A2 

6.78 

35.34 

11.44 

-5.53 

5.50 

University  of  Oregon 
(N»4) 

33.50 

6.37 

46.63 

11.70 

4.71 

6.04 

University  of  Kansas 
(N=12) 

35.16 

5.82 

42.21 

9.99 

-1.32 

8.03 

High/Scope  (N=*0) 

4c 

* 

4c 

4c 

EDC  (Na6) 

26.38 

6.95 

32.09 

10.12 

-2.93 

7.03 

NFT  (N»13) 

38.25 

8.71 

53.15 

5.3«" 

6.62 

9.40 

Insufficient  classrooms  were  both  tested  and  observed  in  the  third  grade 
for  High/ Scope  for  their  model  to  be  included  in  the  analysis. 
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Classrooms  where  adults  focused  their  attention  upon  one 
or  two  children  (Var.  155,  156,  and  483c),  rather  than  the  small  or  large 
group,  had  children  who  performed  less  well  on  the  reading  tests.  Small 
groups  seemed  the  be'^t  configuration  in  first  grades  while  large  groups 
(9  or  more  children)  were  better  for  third  grades. 

Both  University  of  Kansas  and  University  of  Oregon  who 
use  many  of  the  processes  that  were  positively  related  to  the  reading 
scores  had  higher  adjusted  residual  gain  scores  in  reading  than  did  other 
sponsors  and  Non-Follow  Through  (see  Table  116).    Their  raw  scores  in 
first  grade  were  also  higher  than  those  of  other  sponsors. 

Of  the  sponsors  in  third  grade.  Far  West  and  University 
of  Oregon  had  the  highest  raw  scores.    University  of  Oregon,  however, 
was  the  only  sponsor  to  have  a  positive  adjusted  score.     Far  West,  as 
previously  noted,  had  an  exceptionally  high  entering  baseline  score  and 
thus  rarely  showed  a  positive  adjusted  score  even  if  the  raw  score  was 
high.     Non-Follow  Through  in  third  grade  reading  showed  both  a  h:'gher 
raw  score  and  adjusted  score.    This  is  the  only  instance  where  the  pooled 
Non-Follow  Through  group  obtained  a  test  score  higher  than  all  Follow 
Through  sponsors. 

c.  ^  Summary 

Children  who  performed  well  on  tests  of  reading  and  math 
seemed  to  be  in  classrooms  where  more  time  was  spent  iu  developing  aca- 
demic skills.    Several  variables  related  to  time  spent  on  reading  and 
math:     duration  of  the  school  day,  average  time  each  child  spent  in  read- 
ing or  math  or  related  subjects,  and  the  frequency  of  academic  verbal 
interactions.    These  variables  were  positively  related  to  reading  and 
math  scores  in  both  first  and  third  grades.    The  findings  are  •'.n  agree- 
ment with  Wiley  (1973)  who  concluded  that  **the  quantity  of  schooling  is 
an  important  determinant  of  achievement.**    The  reader  is  reminded  that 
the  time  a  child  spends  in  reading  or  arithmetic  activities  is  computed 
over  the  entire  day  and  includes  all  of  those  informal  occasions  where 
a  child  may  be  reading  to  himself  or  to  another  child  as  well  as  the 
formal  instruction  where  an  adult  is  conducf'ng  a  lesson.    Thus,  it  is 
the  average  amount  of  time  a  child  spends  during  the  day  in  reading  or 
math  or  related  activities — noc  just  formal  drill* 

8.      Summary  of  'the  Findings  from  Partial  Correlations  of 
Instructional  Processes  and  Outcomes 

a.      Intercorrelations  of  Outcome  Variables 

The  outcome  scores  varied  differentially  in  their  correla- 
tion with  process  variables.     For  the  most  part  the  MAT,  absence,  the 
child  behaviors,  the  Raven's,  the  Coopersmith,  and  the  lAR  appear  to  be 
measuring  different  aspects  of  child  growth  and  development. 
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An  intercorrelation  of  all  outcome  raw  scores  (see  Table 
117),  indicates  that  at  both  grade  levels  the  highest  correlations  are 
found  among  ♦:he  MAT  reading  and  math  tests.    This  finding,  of  course,  is 
Co  be  expected  and  the  reader  is  reminded  that  reading  scores  were  posi- 
tively correlated  to  the  amount  of  time  children  spent  in  studying  math. 
The  two  skills  are  closely  related. 

The  WRAT  was  more  predictive  of  reading  scores  in  the  fiisl 
grade  (.71)  than  other  outcomes.     The  next  highest  correlations  of  the 
WRAT  were  with  reading  and  the  Raven's  in  the  third  grade  (.66,  .64). 
There  was  more  relationship  between  high  scores  on  the  WRAT  and  a  child's 
accepting  responsibility  for  his  success  (.44)  than  for  accepting  respon- 
sibility for  his  failure  (.24).     This  suggests  that  classrooms  in  which 
children  enter  school  with  more  ability  (as  measured  by  the  WRAT)  are 
more  likely  to  have  children  who  take  responsibility  for  their  success: 
they  are  not  as  likely  to  have  children  who  tak"*  responsibility  for  their 
failure. 

The  highest  correlation  oi  Absence  Rate  with  other  outcome 
measures  was  with  independence  (-.37)  in  the  third  grade.     This  indicates 
that  in  classrooms  where  children  were  more  independeuL  (engaged  in  mure 
activities  without  adults)  they  were  likely  to  be  absent  less  frequently. 
The  next  highest  correlation  of  absence  rate  was  with  the  lAR  Success 
scale  (-.29).     Classrooms  where  children  took  more  responsibility  for 
their  own  success  tend  to  have  lower  absence  rates.    The  correlation 
with  the  Raven's  was  a.lso  -.29.     Twelve  classroom  process  variables  were 
shared  by  the  Raven'c  and  absence  rat^.    These  processes  describe  the 
more  open  and  flexible  clas.^rooms. 

In  general,  the  correlations  between  child  behaviors  and 
other  outcome  scores  were  quite  low,  suggesting  that  different  abilities 
were  being  measured*     Ajnong  the  child  behaviors  in  first  grade,  the  high- 
est positive  correlation  was  between  child  question  asking  and  verbal 
initiative  (.37).     This  relationship  could  be  expected  since  child  ques- 
tioning is  a  subset  of  verbal  initiative  and  both  were  measuring  related 
behaviors.     Although  the  two  variables  are  related  to  each  other,  they 
did  correlate  differently  with  other  tests  and  contributed  different  in- 
formation.   Verbal  initiative  was  negatively  related  to  math  and  reading 
scores  in  both  first  and  tldrd  grade,  whereas  question  asking  was  not  so 
related.     Independence  and  task  persistence  are  variables  which  are  re- 
lated in  definition,  so  that  each  variable  requires  the  child  to  be  in- 
volved in  a  task  without  an  adult.    They  differ  in  that  independence  was 
recorded  on  the  CCL  and  included  single  children  or  groups  of  chilJren 
engaged  in  any  activity  without  an  adult;  i.e.,  they  could  be  discussing 
a  subject  or  just  working  together.     Task  persistence  was  taken  from  the 
FMO  and  required  that  the  child  be  instructing  himself  or  working  alone 
at  a  task  over  a  period  of  five  recorded  frames.    Any  verbal  interaction 
discontinued  the  task  persistence  code.     The  two  variables  are  related 
in  that  a  clij.ld  who  was  task  persistent  would  be  recorded  on  the  CCL  as 
independent,  but  so  would  many  other  children  who  were  working  and  talking 
together  without  adults.     In  spite  of  the  interdependence  of  the  two 
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variables,  they  correlated  differently  with  test  scores.  In  both  grade 
levels,  task  persistence  was  positively  related  to  ?LAT  reading  and  math 
scores  while  independence  was  negatively  related  to  those  test  scores. 

The  Raven's  had  its  highest  correlations  with  the  WIl^\T 
and  the  MAT  reading  (.64  and  .53).    this  is  interesting  for  reading  since 
in  many  instances  the  process  variables  that  had  significant  positive 
correlations  with  the  Raven's  had  significant  negative  correlations  with 
the  MAT  reading.     This  counter-direction  of  significant  correlations  oc- 
curred 23  times.     The  child  behaviors  that  correlated  most  highly  with 
the  Raven's  were  child  independence  and  cooperation  (.38  and  .43). 
These  same  child  behaviors  had  low  correlations  with  the  WRAT  and  with 
reading.     The  process  variables  which  correlated  positively  with  the 
Raven's  were  those  associated  with  the  more  open  and  flexible  models, 
while  those  which  positively  correlated  with  reading  were  associated  with 
the  more  structured  models. 

The  Coopersmith,  which  is  a  test  of  self-esteem,  had  only 
low  correlations  with  all  outcome  tests,  as  it  did  with  the  process  vari- 
ables.    The  highest  correlation  was  with  the  lAu  Success  scale  (.36). 
There  v>^as  a  tendency  for  classrooms  where  children  had  higher  scores  on 
the  self-esteem  test  to  also  take  responsibility  for  their  success. 

The  lAR  Success  scale  was  more  closely  related  to  the 
Raven's  (.44),  the  WRAT  (.4^f),  and  the  MAT  reading  (.41)  than  other  out- 
come scores.     The  lAR  Success  scale  and  the  Raven's  related  similarly 
to  9  out  of  18  process  variables.     It  is  more  difficult  to  understand 
the  correlation  of  the  lAR  Success  scale  and  the  MAT  reading  since  they 
correlated  differently  on  several  process  variables:     e.g.,  total  dura- 
tion of  day  (MAT  reading  .29,  lAR  Success  -.29),  Child  commands,  requests, 
^nd  asks  direct  questions  in  activities  other  than  reading  or  math  OiAT 
reading  -.27;  lAR  Success  .29).    There  was  no  instance  where  they  were 
correlated  in  the  same  direction  with  the  same  process  vari;^bles. 

The  lAR's  Failure  scale  had  its  highest  correlations  with 
all  of  the  MAT  scores  and  the  process  variables  correlated  similarly  for 
these  test  scores.     In  fact,  the  lAR  Failure  scale  shared  46  out  of  its 
85  significantly  related  process  variables  with  MAT  reading  or  math. 
The  process  variables  positively  related  to  the  lAR  Failure  score  were 
closely  related  to  those  process  variables  which  described  the  struc- 
tured models.     Contrary  to  the  lAR  Success  scale,  there  was  no  correlation 
between  the  lAR  Failure  scale  and  the  Raven's. 

Overall,  excepting  for  the  intercorrelations  of  the  MAT, 
the  correlations  of  outcome  scores  were  low.     Apparently  different  as- 
pects of  child  growth  and  development  were  being  measured. 

b.      Selected  Process  Variables  Related  to  Outcomes 

In  order  to  investigate  the  effect  of  instructional  pro- 
cess variables  on  the  outcomes,  two  instructional  process  variables 
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which  correlated  significantly  with  several  child  outcomes  were  analyzed 
across  all  outcomes:    These  are  "all  adult  praise"  and  "one  child  with 
any  adult."    The  variable  "all  adult  praise"  correlated  both  positively 
and  negatively  with  outcomes  in  both  first  and  third  grades.     Table  118 
presents  these  findings. 


Table  118 

CORRELATIONS  OF  ALL  ADULT  PRAISE 
WITH  OUTCOME  SCORES 


First  Grade:  (N=108) 

Absence  Rate 
Independence 
MAT  Ma»-h 
MAT  Reading 

Third  Grade:  (N=58) 

Absence  Rate 
Independence 
Ravens 
Coopersmith 
lAR  Success 
lAR  Failure 
MAT  Math 
MAT  Reading 


I_  -El 


.14  .001 

-,60  .001 

.39  .01 
,31 


,10  .05 
-,23  .05 
-,32  .05 
-.31  ,05 
-.09 

,07 

,19  .10 
-,01 


In  both  first  and  third  grades,  praise  was  negatively  re- 
lated to  independence.     The  definition  of  "independence''  is  a  child  or 
children  involved  in  a  task  without  adults  (data  were  collected  from 
only  child-focused  observations).     This  independent  behavior  did  not 
flourish  in  classr:;oms  where  there  was  a  high  rate  of  adult  praise  (data 
were  collected  on  adult~f ocused  days).     It  is  interesting  that  out  of 
all  the  interaction  variables  in  first  grade,  only  praise  was  so  nega- 
tively related  (-.60)  to  independence.     It  may  be  that  children  who  are 
praised  a  great  deal  are  in  structured  situations  that  do  not  allow  for 
the  type  of  independent  activity  coded  on  the  SRI  Instrument.    We  do 
not  know  whether  these  children  would  be  more  independent  if  given  the 
opportunity. 

In  the  first  grade,  "All  adult  praise"  was  positively  re- 
lated to  reading  and  math  scores,  but  the  effect  of  praise  upon  academic 
achievement  was  much  less  evident  in  the  third  grade.    This  suggests  that 
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while  first  graders  may  need  more  positive  feedback  to  perform  well  in 
reading  or  math,  this  type  of  feedback  does  not  contribute  to  a  great 
extent  toward  good  performance  in  the  third  grade. 

As  in  the  findings  for  independence,  the  variable  all 
adult  praise  showed  a  negative  effect  upon  performance  on  the  Raven's 
test  and  the  Coopersmith  Self-Esteem  Inventory,    Apparently,  the  more 
tliat  adults  in  classrooms  told  third  grade  children  that  they  were  doing 
well    the  less  likely  the  children  were  to  score  high  on  perceptual 
problem-solving  tasks,  respond  positively  about  themselves,  or  take  re- 
sponsibility for  success  or  failure. 

Since  all  of  the  correlations  presented  were  partialed  on 
♦-he  baseline  WRAT,  an  exploratory  analysis  was  conducted  to  see  whether 
classrooms  in  which  the  children  entered  school  with  differing  abilities, 
as  measured  by  the  WRAT,  would  show  different  results  in  process  and  out- 
come rf^lationships.    Classrooms  in  both  the  first  and  the  third  grades 
were  divided  into  three  groups  (high,  medium,  and  low)  based  on  the  class- 
room mean  baseline  WRAT  score.     Columns  one,  two,  and  three  of  Table  119 
present  these  findings.    Children  in  first  grade  classrooms  with  low  or 
medium  entering  ability  scores  seemed  to  be  more  affected  by  praise  from 
adults;  children  in  classrooms  where  entering  ability  was  high  were  rel- 
atively less  affected. 


Table  119 

CLASSROOMS  WITH  LOW,  MEDIUM,  HIGH  MEANS— PARTIAL  CORRELATIONS 
OF  "ALL  ADULT  PRAISE"  WITH  OUTCOME  TEST  SCORES 


WRAT 

WRAT 

I'JRAT 

Low 

Medium 

HiRh 

Outcomes 

r  p< 

r  p< 

^            P.<  . 

Firsr  Grade: 

(N=36) 

(N=36) 

(N=36) 

Absence  Rate 

.25  .05 

-.05 

.07 

Independence 

-.58  .001 

-.73  .001 

-.37  .01 

MAT  Math 

.Jl  .05 

.53  .001 

.06 

MAT  Reading 

.39  .001 

.A3  .001 

.02 

Third  Grade: 

(N=19) 

(N=20) 

(N=19) 

Absence  Rate 

.00 

-.15 

.15 

Independence 

-.27 

-.32 

-.28 

Raven' s 

-.bO  .01 

-.53  .001 

.26 

Coopersmith 

-.A2  .05 

-.09 

-.36 

lAR  Success 

-.07 

-.OA 

-.03 

lAR  Failure 

.OA 

-.13 

.23 

MAT  Math 

.21 

-.18 

.31 

MAT  Reading 

.04 

-.31 

.16 
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In  the  third  grade,  all  of  the  significant  correlations 
were  negative,  and  all  of  the  correlations  for  the  medium  ability  group 
were  negative,  including  those  for  reading  and  math. 

The  reader  is  reminded  that  third  grade  math  achievement 
and  time  spent  were  analyzed  by  ability  level,  and  the  findings  suggest 
that  children  with  lower  ability  were  likely  to  achieve  more  if  they 
spent  more  time  in  math  activities. 

Thus,  we  can  hypothesize  that  low~ability  first  grade 
children  will  achieve  more  on  the  reading  and  math  tests  if  they  receive 
more  praise,  and  low-ability  children  in  the  third  grade  will  achieve 
more  if  they  spend  more  time  in  math  activities,     k  study  examining  more 
of  the  interaction  between  child  abilities  and  treatment  would  be  of  great 
value  in  planning  educational  programs  for  children  of  differing  abili- 
ties and  differing  age  groups. 

Another  instructional  variable  that  was  examined  across 
all  outcomes  was  "One  child  with  any  adult."    Table  120  presents  these 
findings.     Findings  from  this  table  indicate  that  when  children  had  in- 
dividualized attention  in  the  first  or  third  grade,  they  were  absent  less 
frequently  and  they  were  more  often  independent.    First  grade  math  and 
reading  scores  were  adversely  affected  by  individualized  attention.  This 


Table  120 

PARTIAL  CORRELATIONS  OF  ONE  CHILD  WITH  ANY  ADULT 
AND  ALL  OUTCOME  SCORES 


First  Grade  Overall:  (N=108) 


Absence  Rate  -.35  .001 
Independence  . 44  . 001 

MAT  Math  -.20  .05 

MT  Reading  -.33  .001 

Third  Grade:  (N=58) 

Absence  Rate  -.30  .01 
Independence  .39  .001 

Ravens  .32  .05 

Coopersmith  . 04 

lAR  Success  .05 

lAR  Failure  -.18  .10 

MAT  Math  -.13 

MAT  Reading  "  -.12 
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reverses  a  previous  finding  (Stallings,  1973)  which  indicated  that  in- 
dividualized attention  was  positively  related  to  academic  achievement. 
Third  grade  scores  in  reading  and  math  were  not  significantly  affected 
by  individualized  attention.     However,  children  from  classrooms  where 
adults  were  observed  to  be  with  one  child  at  a  time  received  higher 
scores  on  the  Raven's  test. 

The  Absence  Rate  in  first  grade  classrooms  with  low-  and 
medium-ability  groups  was  apparently  affected  more  positively  by  having 
adults  provide  individual  attention  than  those  classrooms  with  high- 
ability  groups.     The  independence  of  the  ability  groups  in  first  grade 
was  about  equally  affected  by  individualized  attention. 

In  the  third  grade,  the  absence  rate,  independence,  and 
Raven's  scores  were  more  positively  affected  by  individualized  attention 
if  the  classrooms  had  a  mean  score  in  the  medium-  or  high-ability  groups. 
Only  the  uigh-ability-group  scores  on  the  Coopersmith  and  lAR  Success 
scale  were  positively  affected  by  having  adults  working  with  one  child. 
The  medium-  and  low-abil^  ty-group  scores  on  the  lAR  Failure  scale  vvcr^ 
negatively  affected  by  the  individualized  attention — suggesting  that  the 
higher  ability  children  take  responsibility  for  their  success  if  they  are 
dealt  with  on  a  one-to-one  basis,  and  the  children  with  less  entering 
ability  take  less  responsibility  for  their  success  or  failure  if  they 
receive  individualized  attention. 

The  MAT  scores  were  negatively  affected  in  all  ability 
groupings  in  both  grade  levels  by  individualized  attention.     In  the  third 
grade,  the  correlations  were  low  and  the  least  effect  was  recorded  in  the 
third  grade  high-ability  group.    As  was  noted  earlier,  other  configura- 
tions (such  as  small  groups  for  first  grade  and  large  groups  for  third 
grade)  were  related  to  reading  achievement. 


B.  Regressions 

1.      Stepwise  Regressions 

The  purpose  of  this  section  is  to  examine  the  relationship  of 
the  process  variables,  as  a  group,  to  the  outcome  scores.     In  the  previous 
part,  we  examined  the  relationship  of  classroom  processes  to  outcome 
scores  by  looking  at  the  partial  correlations  of  each  of  a  selected  set 
of  classroom  observation  variables  with  each  outcome  variable.  Obviously, 
many  of  the  classroom  observation  variables  included  in  the  partial  cor- 
relation analysis  are  closely  related,  either  because  of  the  way  they  are 
defined  or  because  certain  processes  occur  together  in  the  classroom. 
Table  121  presents  the  correlations  among  some  of  the  process  variables 
that  were  found  to  have  high  partial  correlations  with  the  designated 
outcome  score.    Also  included  are  the  correlations  of  the  process  vari- 
ables with  the  outcome  test  score  and  the  baseline  l-ZRAT  score.     An  examin- 
ation of  this  table  reveals  that,  as  expected,  most  of  the  correlations 
among  the  process  variables  are  moderately  high,  between  .30  and  .50, 
with  some  as  high  as  .80. 
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Table  121 


CORREUTIONS  AMONG  SELECTED  PROCESS  VARIABLES,  OUTCOME  SCORES,  AND  BASELINE  WRAT 
FIRST  AND  THIRD  GRADES 
MAT  READING 


S73 
MAT 

F7l      R«ad-  Var .    Var .    Var.    Var .    Var.    Var.  Var. 

VRAT      Ing  _6_7_     88      163      2U0^     402a    412a  469a 


FIRST  GRADE  (N'105) 


F71  WRAT 

S73     MAT  Reading 

67     Reading,  alphabet,  language  developnent 

3d     Teacher  with  snail  group 

163     Approxiaace  nutsber  ot  children  Involved  In 

Recd*t«g,  all  days  observed 
240     Texts,  vorkbooks/Acadealc  Acdvlcles 
402a    Ad^iU  praise,  acadealc 

412a    Adult  feedback  to  child  reaponses  to  aduU 

acadealc  cocsanda.  requests,  and  questions 
4(>9;i    All  adult  relnforceoent  with  tokens 
509^    Child  self-Instruction,  acadealc 
S66c    Total  acadealc  verbal  Interactions 
$82c    Adult  acadealc  coeaunds,  requests,  and  direct 
questions  to  children 


1.00  .71 
1.00 


.06 

-  11 

.03 

-.01 

-.09 

-.09 

-.10 

-.07 

.06 

-.06 

.32 

.09 

33 

.15 

.13 

.22 

.15 

.23 

.39 

.20 

1.00 

.32 

.85 

.52 

.38 

.53 

.37 

.55 

.54 

.38 

1.00 

.18 

.21 

.42 

.49 

.38 

.36 

.43 

.46 

1.00 

.39 

.43 

.59 

.41 

.48 

.51 

.35 

1.00 

.30 

.42 

.29 

.29 

.26 

.26 

1.00 

.69 

.93 

.37 

.38 

.43 

1.00 

.61 

.51 

.59 

.57 

1.00 

.37 

.35 

.35 

1.00 

.77 

.27 

1.00 

.64 

1.00 

S73 
HAT 

F69      Read-  Var.    Wat.    Var.  Var. 

WRAT      ing..  15      146      163  242 


Var. 

3S3a 


Var.  Var.  Vsr. 
363a    441a  444a 


Var. 

566c 


THIRD  GRADE  (S-57) 


^69 

S73 
13 

146 
163 


353a 


444a 
566c 


WRAT 

.MAT  Reading 

Chlld/Tcacher  and  Aide  Ratio  (nuaber  of  children 

over  teachers  and  aides) 
Large  group  with  teacher /Reading 
Approximate  nuaber  of  children  involved  In 

Reading,  all  days  observed 
Percent  CCLs  In  whlc^  an  acadealc  activity  Is 

occurrlfig  ' 

Adulc  coaaands.  requests,  and  direct  questions  to 

groups  of  children,  acadealc 
Child  group  response  to  adult  acadealc  cocraands, 

requests,  or  direct  questions 
Adult  cooBunlcatlon  or  attention  tocus,  large 

group 
Aiiult  aoveoent 

Total  acadealc  verbal  interactions 


.65 
1.00 


.19 

-.00 

-.02 

.08 

-  11 

-.13 

-.08 

.16 

.03 

.49 

.36 

.12 

.24 

.16 

.16 

.34 

.42 

.29 

1.00 

.59 

-.02 

.10 

.13 

.08 

.59 

.40 

-.04 

1.00 

.08 

.27 

.36 

.32 

.71 

.36 

.16 

1  00 

.70 

.41 

.45 

.03 

.29 

.51 

1.00 

.48 

.53 

.02 

.31 

.54 

1.00 

.89 

.39 

.39 

.54 

1.00 

.30 

.38 

.66 

1.00 

.40 

-.00 

1.00 

.30 

1.00 
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Table  121  (Concluded) 


CORRELATIONS  AMONG  SELECTED  PROCESS  VARIABLES,  OUTCOME  SCORES.  AND  BASELINE  WRAT 
FIRST  AND  THIRD  GRADES 
MAT  MATH 


S73 
MAT 


FIRST  GRADE  (S-105) 


F71  WRAT 

S73  MAT  Math 

;02a  AduU  praise,  acac^emlc 

412a  AduU  feedback,  to  child  responses  to  adult 

acadeaic  cosaands,  requests,  and  questions 

509c  Child  self-Instruction,  acadcnic 

17  Total  class  duration 

66  Numbers,  nath,  arlthoetlc 

140  Approxlaate  number  of  children  Involved  In  Math, 

ail  days  observed 

360a  Child  resDonses^  jcadcslc 

395a  AduU  acknovledgeent  to  rhildrcn,  acadenic 

399a  Adult  relnforceoent  with  token,  academic 

i06a  Adult  positive  corrective  feedback,  academic 

435a  Total  academic  verbal  Interactions 


.59 
1.00 


-.09 
.26 
1. 00 


S73 
MAT 


THIRD  GRADE  (N-57) 


r69  WRAT 
S73      MAT  Ma:h 

353a    Adult  cocsmands,  requests,  and  direct  questions  to 

group*  of  children,  jcadcmlc 
363a    Child  group  response  to  adult  academic  cosaaands, 

requests,  or  direct  questions 
444a    Adult  tsoveaent 
17      Total  class  duration 
66      Sunbers,  oath,  arithmetic 
123      Large  group  with  teacher/Math 

140     Approximate  number  of  children  Involved  '.  Math, 

all  days  observed 
240     Texts,  workbooks/Acadealc  Activities 
402a    Adult  praise,  academic 
435a    Total  academic  verbal  Interactions 
582c    Adult  academic  cocaaands,  requests,  and  direct 

questions  to  children 


Var . 

Var. 

Var. 

Var. 

Var. 

Var. 

Var. 

Var. 

Var. 

Var. 

4 12a 

17 

66 

140 

360a 

395a 

399a 

406a 

435a 

-.09 

-.07 

.12 

.i; 

.12 

-.02 

.03 

-.09 

.04 

.14 

.31 

.16 

.28 

.33 

.36 

.32 

.25 

.27 

.38 

.42 

.69 

37 

.42 

.28 

.35 

.56 

.12 

.95 

.42 

.52 

1 .00 

.51 

.51 

.40 

.45 

.77 

.74 

.61 

.51 

.70 

1.00 

.23 

.16 

.19 

.53 

.32 

.35 

38 

.58 

1.00 

.33 

.36 

.32 

.34 

.41 

.28 

.38 

1,00 

.93 

.46 

.32 

.24 

.33 

.46 

1.00 

.45 

.34 

.28 

.35 

.45 

1.00 

.50 

.45 

.58 

.83 

1.00 

.03 

.36 

.53 

1.00 

.36 

.43 

1 .00 

.52 

1.00 

Var. 

Var. 

Va. . 

Var. 

Var. 

Var. 

Var. 

Var. 

Var. 

Var. 

363a 

4_44a 

_17 

66 

123._ 

140 

240 

402a 

435a 

582c 

-  13 

.16 

-.02 

.03 

-.10 

.03 

.19 

-.25 

.09 

-.20 

.42 

.46 

.38 

.48 

.39 

.49 

.11 

.16 

.41 

.40 

.89 

.39 

.09 

.35 

.44 

.30 

.16 

.25 

.60 

.65 

1.00 

.38 

.12 

.43 

.44 

37 

.24 

.34 

.71 

.61 

1.00 

.09 

.30 

.42 

.3C 

.21 

.13 

.32 

.19 

1.00 

.28 

.27 

.33 

.  17 

.15 

.10 

.12 

1.00 

.24 

.86 

.34 

.34 

.49 

.44 

1.00 

.25 

-.08 

-.17 

.14 

.27 

1.00 

.36 

.36 

.42 

.38 

1.00 

.35 

.48 

.25 

1.00 

.45 

.38 

1.00 

.61 

1.00 
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Because  of  the  relationships  among  the  process  variables,  it  was 
impossible  to  determine  fiom  the  partial  correlations  the  unique  con- 
tribution each  variable  made  of  the  prediction  of  the  outcome  scores. 
It  is  also  impossible  to  piece  together  the  total  relationship  between 
the  classroom  processes  and  the  outcome  scores.     In  this  section  the 
relationship  between  the  classroom  process  as  a  whole  and  the  outcome 
scores  is  examined.    Multiple  regression  analysis  was  used  to  this  end. 

A  set  of  process  variables  was  chosen  separately  for  e  .,h  outcome 
score  based  on  the  partial  correlations  in  the  first  part  of  the  section. 
A  stepwise  multiple  linear  regression  was  run  separately  for  each  grade 
level  with  each  outcome  score  as  the  dependent  variable  and  the  set  of 
selected  process  variables  and  the  baseline  WRAT  score  as  the  independent 
variables.    The  baseline  WRAT  score  was  placed  in  the  regression  on  the 
first  step.    The  process  variables  were  added  one  at  a  time  until  a  total 
of  20  variables  had  been  included*    Of  particular  interest  in  examining 
the  relationship  of  the  set  of  process  variables  to  the  outcome  variables 
is  the  degree  to  which  the  set  of  process  variables  "predicted"  the  outcome 
after  the  effect  of  the  baseline  WRAT  had  been  accounted  for*    The  coeffic- 
ient of  determination,  r2,  was  used  to  this  end.     Since  the  baseline  WRAT 
entered  the  regression  at  the  first  step,  the  R2  on  this  step  was  a  mea- 
sure of  the  degree  to  which  the  baseline  WRAT  score  accounted  for  the 
variance  in  outcome  score.     The  difference  between  the  value  of  R^  at 
any  subsequent  stage  and  the  R2  at  the  first  step  was  a  measure  of  the 
degree  to  which  the  process  variables  provided  a  prediction  of  the  outcome 
scores  beyond  that  available  from  the  baseline  WRAT  alone •     The  signif- 
icance of  the  contribution  of  any  variable  that  is  added  to  the  regres- 
sion is  indicated  by  the  "f-to-enter"  statistic.    This  statistic  corre- 
sponds to  the  test  of  whether  the  variable,  when  it  entered  the  regres- 
sion, had  a  partial  regression  coefficient  significantly  different  from 
zero.     Variables  were  added  until  no  further  significant  increases  in 
R^  occurred.     It  should  be  noted,  however,  that  the  obtained  R^  was  an 
overestimate,  since  to  some  extent  the  procedure  capitolizes  on  chance 
in  the  build  up  of  the  total  value. 

For  the  behavioral  outcome  variables  (the  process  varialbes  such 
as  child  questions  and  cooperation)  and  days  absent,  the  \^AT  R^  values  at 
the  first  step  (where  WRAT  was  entered)  were  zero  or  very  small  (see  Table 
122)  indicating  that  the  WRAT  accounts  for  very  little  of  the  variance  for 
the  child  behavior.  For  the  test  outcome  variables,  the  WRAT  r2  values  at 
the  first  step  were  high  for  the  MAT  reading  at  both  grade  levels,  for  the 
MAT  math  at  first  grade  and  for  the  Raven's  at  third  grade*  The  WRAT  R^ 
values  at  the  first  step  were  modest  for  the  MAT  math  and  the  lAR  Success 
and  Failure  scales  at  third  grade. 

The  contribution  of  the  process  variables  to  the  R'^  value  was  sub- 
stantial for  all  process  variable  outcome  scores.     For  the  behavioral  out- 
come variables,  the  increment  in  R^  from  the  first  step  ranged  from  .22  to 
.67  in  first  grade  and  from  .38  to  .61  in  third  grade.     For  days  absent,  the 
increment  was  an  amazing  .66  and  .62  for  first  and  third  grade,  respectively. 
For  the  test  outcome  variables,  the  increment  ranged  from  .23  for  MAT 
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reading  at  the  first  grade  to  .7?  for  the  lAR  Failure  scale  at  the  third 
gri^'ie.    All  these  increases  are  substantial.    They  are  evidence  that  the 
classroom  processes  were  definitely  related  to  behavioral  a;id  test  out- 
comes beyond  the  influence  of  initial  ability.    The  results  for  the  days- 
absent  variable  are  very  striking.    They  indicate,  at  least  indirectly, 
that  there  ma"  be  a  very  strong  relationship  between  classroom  processes 
and  the  rate  ot  absence.    More  than  two-thirds  of  the  variability  in  this 
outcome  was  accounted  for  by  the  classroom  process  variables  and  the 
baseline  WRAT.     Note  that  an  r2  value  in  the  range  of  .67  to  .69  corre- 
sponds to  a  multi; -e  correlation  in  the  neighborhood  of  .82. 

In  che  test  outcome  domain,  the  contribution  of  the  process 
variables  were  substantial  across  the  board.    For  the  MAT  reading  and 
math  outcome  scores,  the  results  for  first  and  third  grade  are  very 
similar.    The  process  variables  added  more  than  ,40  to  the  value 
for  MAT  math  and  more  than  .25  to  the  R^  value  for  Mi^.T  reading.  For 
both  grade  levels  the  R^  at  the  last  step  corresponded  to  a  multiple 
correlation  between  .85  and  .90.    For  the  Raven's,  the  COI  variables  in- 
cremented the  R^  value  by  more  than  the  baseline  WRAT.    This  indicates 
that  the  classroom  processes  may  be  as  important  a  factor  as  initial 
ability  in  accounting  for  performance  on  the  Raven's.    The  results  on 
the  J.AR  Failure  scale  are  also  amazing.    The  baseline  WRAT  accounted 
for  only  4%  of  the  variability,  and  wh.in  the  COI  variables  were  added, 
the  coefficient  of  determination  was  .83.     This  corresponds  to  a  mul- 
tiple correlation  coefficient  of  over  .90.     Though  such  values  are  clearly 
overestimates  the  result  provides  compelling  evidence  for  a  strong  re- 
lationship ■  ewween  the  way  children  take  responsibility  for  their  fail- 
ures and  the  classroom  processes  to  which  they  are  exposed. 

The  number  of  process  variables  included  in  the  regressions 
before  the  **F-to-enter**  dropped  below  the  .05  level  was  a  minimum  of  two, 
for  Child  Questions,  and  a  maximum  of  14,  for  days  absent  at  the  first 
grade  level   'see  Table  122).    For  the  most  part,  the  number  of  process 
variables  that  entered  tha  regression  was  between  2  and  6  fc  r  the  be- 
havioral outcomes  and  between  7  and  11  for  the  outcome  test  scores.  The 
number  of  the  variables  that  entered  any  particular  regression  relative 
to  the  number  of  process  variables  included  is  an  indication  of  the  high 
degree  of  dependency  among  the  process  variables. 

Table  123  gives  the  detailed  results  for  each  dependent  vari- 
able for  the  iteps  in  the  regression  prior  to  the  first  encounter  of  an 
"F-to-enter"  that  was  not  significant  at  the  .05  level.  Included  for 
3ach  step  are:  the  variable  that  entered^  the  multiple  correlation  co- 
efficient R;  the  coefficient  of  determination  R^;  the  change  in  R^  from 
the  previous  step;  and  the  "F-to-enter."  Tbs  interested  reader  is  re-^ 
f-erred  back  to  the  partial  correlation  discussions  in  the  first  part  of 
this  section  for  the  detailed  discussion. 
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Table  123 


STATISTICS  FROM  THE  STEPWISE  REGRtSSION  OP  THE  BASELINE  WRAT 
AND  SELECTED  COI  VARIABLES  ON  THE  OUTCOME  SCORES 


Variable  Multiple        ^         ^^Q  F-to- 

Step         No.  Variable  Name                                   R            R       Change  Enter 

Dependent  Variable:     CM  Id  Questions 
First  Grade  (N-105) 


F71  WR/Vr 

.025 

.001 

.001 

067 

Adult  communication  or 

attention  focus, 

child 

.385 

.148 

.147 

17 

641 

Adult  general  comments 

to  children 

.528 

.279 

.131 

18 

359 

Third  Grade  (N'=57) 


1 

r69  WRAT 

.056 

.003 

.003 

.176 

2 

389a 

Adult  general  comments  to  children 

.366 

.134 

.131 

8.  169 

3 

2  36 

TV 

.495 

.250 

.115 

8.145 

4 

398a 

All  adult  praise  to  children 

.540 

.292 

.042 

3.103 

Dependent  Variable]^  Self-Esteem 
First  Grade  (N-105) 


1 

F71  WRAT 

.045 

.002 

.002 

213 

2 

440a 

Adult  communication  or  attention  focus, 

small  group 

.477 

.228 

.226 

29 

815 

3 

439a 

Adult  communication  or  attention  focus. 

two  children 

.581 

.337 

.109 

16 

680 

4 

394a 

All  adult  acknowledgment  to  children 

.627 

.393 

.056 

9 

147 

5 

451a 

Adult  academic  commands ,  requests ,  and 

direct  questions  to  children 

.666 

.443 

.050 

8 

946 

6 

104 

Adult  with  cne  child 

.696 

.484 

.041 

7 

816 

Third  Grade  (N»57) 


1 

F69  WRAT 

.090 

.008 

.008 

449 

2 

390a 

Adult  task-related  comments  to  children 

.291 

.084 

.076 

4. 

503 

3 

389a 

Adult  general  comments  to  children 

.401 

.161 

.077 

4. 

848 

4 

240 

Texts,  worKbooks 

.474 

.224 

.06^^ 

4. 

232 

5 

83 

Wide  variety  of  activities  over  one  day 

.536 

■  287 

.063 

4. 

486 

6 

24 

Child  selection 

.604 

.365 

.  .078 

6. 

110 

7 

394a 

All  adult  acknowledgment  to  children 

.646 

.418 

.053 

4. 

462 

Dependent  Variable:    Child  Independence 
First  trade  (N«105) 


1 

F71  WRAT 

.060 

.004 

.004 

373 

2 

J98a 

All  adult  praise  to  children 

.598 

.357 

.354 

56 

158 

3 

104 

Adult  with  one  child 

.732 

.536 

.178 

38 

782 

4 

16 

Child/adult  ratio 

.779 

.606 

.070 

17 

862 

5 

82 

Wide  variety  of  activities;  concurrent 

.805 

.649 

.043 

12 

001 

6 

439a 

A^^  t  communication  or  attention  focus. 

tv^o  children 

.817 

.668 

.019 

5 

626 

Third  Grade  (N-57) 


1 

F69  WRAT 

.094 

.009 

.009 

2 

394a 

All  adult  aknowledgment  to 

children 

.482 

.232 

.223 

3 

104 

Adult  with  one  child 

.580 

.336 

.104 

4 

452a 

Adult  open-ended  questions 

to  children 

.641 

.411 

.075 

.487 
15.687 
8.302 
6.596 


Dependent  Variable:    Task  Persistence 
First  Grade  (N«105) 


1 

F71  WRAT 

.054 

.003 

.003 

.306 

2 

83 

Wide  variety  of  activities  over  day 

.367 

.135 

.132 

15.529 

3 

375a 

Adult  instructs  an  individual  child 

.445 

.198 

.063 

7.917 

4 

237 

Audio  visual  equipment 

.487 

.237 

.040 

5.190 

5 

240 

T'sts,  workbooks 

.524 

.275 

.038 

5.119 
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Table  123  (Continued) 

STATISTICS  FROM  THE  STEPWISE  REGRESSION  OF  THE  SAGbtlNE  WRAT 
AND  SELECTED  COI  VARIABLES  ON  THE  OUTCOME  SCORES 


Variable 
Step  No. 


Variable  Name 


Multiple 
R 


RSQ  F-to- 
Change  Enter 


Dependent  Variable:    Task  Persistence 


First 

Grade  (N" 

150)  (Continued) 

6 

451a 

Adult  academic  command ,  request,  and  direct 

(Questions  to  children 

7 

440a 

Adult  communication  or  attention  focus, 

small  group 

8 

16 

Child/adult  ratio 

9 

365a 

Adult  responses  to  child  request  or  ques- 

t Ion ,  nonacademic 

10 

4  38a 

Adult  communication  or  attention  focus,  one 

child 

Third 

Grado  (N- 

57) 

1 

F69  WRAT 

2 

240 

Texts ,  workbooks 

3 

364a 

Adult  responses  to  child  requests  or  ques- 

tions, academic 

4 

83 

Wide  variety  of  activities  over  one  day 

5 

16 

Child/adult  ratio 

6 

104 

Adult  with  one  child 

239 


Math  or  science  equipment 


Dependent  Variable:  Cooperation 
First  Grade  (N-105) 

1  F71  WRAT 

2  240         Texts,  workbooks 

3  390a       Adult  task-related  comments  to  children 
Third  Grade  (N«57) 


1 

F69  WRAT 

2 

240 

Texts,  workbooks 

3 

45 

Total  different  resource  categories  coded 

"used  today"  over  three  days 

4 

40 

General  equipment,  materials  used 

5 

82 

Wide  variety  of  activities,  concurrent 

6 

237 

Audio  visual  equipment 

Dependent  Variable:     Verbal  Initiative 
First  Grade  (N-105) 

1  F71  WRAT 

2  365a       Adult  responses  to  child  request  or  ques- 

t  ion ,  nonacademic 

3  28         Instructional  materials  used 

4  45         Total  different  resource  categories  coded 

"used  today"  over  three  days 

Third  Grade  (N-57) 

1  F69  WRAT 

2  104         Adult  with  one  child 

3  ^51a       Adult  academic  commands,  requests,  and 

direct  questions  to  children 


556 

.309 

.034 

4.877 

587 

.344 

.035 

5.161 

609 

.  371 

.  027 

4  .053 

633 

.401 

.030 

4.794 

661 

.437 

.036 

6.054 

241 

.058 

,058 

3.377 

592 

.  350 

.  292 

24 . 280 

A 

0  jo 

.  ^  J  ^ 

.  yJOc 

7 

698 

.488 

.055 

5.621 

725 

.526 

.038 

4.085 

756 

.572 

.046 

5.  421 

781 

.610 

0.3b 

4.746 

004 

.000 

.001 

.128 

491 

.241 

.241 

32.759 

569 

.324 

.082 

12.421 

117 
Ji  / 

.  iUU 

.  lUU 

A    1  A  A 

571 

.326 

.226 

18.082 

A/.  A 

.  U7i 

723 

.523 

.106 

11.535 

754 

.569 

.046 

5.479 

779 

.606 

.037 

4.717 

020 

.000 

.000 

.040 

312 

.098 

.098 

10.980 

379 

.144 

,C'*6 

5.467 

463 

.215 

,071 

9.032 

002 

.000 

.000 

.151 

497 

.247 

.247 

18.033 

618 

.382 

.081 

6.934 
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Table  123  (Continued) 


STATISTICS  FROM  THK  STEPWISE  REGRESSION'  OF  THE  BASELINE  WRAT  * 
/VND  SELECTED  COI  VARIABLES  ON  THE  OUTCOME  SCORES 


Variable 

Multiple 

? 

RSQ 

F-to- 

Step 

No. 

Variable  Name 

R 

R^ 

Change 

Enter 

ependent  Variable 

:    Days  Absent — Positive  and  Negative 

First 

Grade  (N«105) 

1 

F71  WRAT 

.  118 

.  014 

•  014 

1 . 456 

2 

104 

Adult  with  one  child 

.  379 

.  144 

15 . 470 

3 

231 

Volunteer  involved 

.475 

.226 

.  082 

10. 700 

596c 

Adult  feedback  to  children  for  behavior 

.  539 

.  290 

.064 

9.065 

5 

471a 

Adults  attentive  to  large  group 

.604 

.  365 

.075 

11 . 733 

6 

462a 

All  positive  behavior 

.638 

.406 

.041 

6.786 

7 

85 

Teacher  without  children 

.667 

.445 

.039 

6.765 

8 

256 

Practical  skills  acquisition 

.691 

.478 

.033 

6.025 

9 

127 

Large  group  with  aide 

.710 

.304 

..026 

4.965 

10 

417a 

Children  attentive  to  adults,  academic 

.727 

.529 

.025 

5.024 

11 

453a 

Adult  responds  to  child's  question  v»ith  a 

question 

.754 

.568 

.039 

8.349 

12 

353a 

Adult  commands,  requests,  and  directs  ques- 

tions to  groups  of  children,  academic 

.770 

.593 

'  .026 

5.794 

13 

601c 

All  adult  neutral  corrective  feedback 

.788 

.621 

.027 

6.543 

14 

585c 

Child's  extended  response  to  question 

.808 

.653 

.033 

8.533 

15 

125 

Two  children  with  aide 

.819 

.670 

.017 

4.454 

Third  Grade  (N-^7) 


1 

F69  WRAT 

.272 

.074 

.074 

4 

485 

2 

463a 

All  negative  behavior 

.536 

.288 

zl4 

16 

500 

3 

125 

Two  children  with  aide 

.624 

.390 

.102 

9 

012 

4 

114 

One  child  without  adults 

.710 

.504 

.115 

12 

260 

5 

371a 

Child  extensive  response  to  adult  open-ended 

question 

.758 

.575 

.071 

8 

689 

6 

417a 

Children  attentive  to  adults,  academic 

.801 

,642 

.067 

9 

477 

7 

351a 

Adult  commando,  requescs,  and  directs  ques- 

tions to  groups  of  children,  nonacademlc 

.829 

.687 

.045 

7 

274 

Dependent  Variable;    .MAT  Math 


First 

Grade  (N» 

105) 

1 

F71  WRAT 

.594 

.353 

56.095 

2 

412a 

Adult  feedback  to  children  responding  to 

adult  academic  command  or  question 

.697 

.485 

.133 

26.319 

3 

369a 

Child  extended  response,  nonacademlc 

.742 

.550 

.065 

14,570 

4 

408a 

Adult  positive  corrective  feedback,  academic 

.771 

,594 

.044 

10.790 

5 

441a 

Adult  conanunlcat ion  or  attention  focus. 

group 

.791 

.625 

.031 

8.309 

6 

469a 

All  adult  reinforceoient  with  tokens 

.809 

.654 

.029 

8.197 

7 

370a 

Child  extended  responses,  academic 

.825 

.681 

,027 

8.074 

8 

354a 

Adult  communication,  request,  and  direct 

question  to  Individual  child,  academic 

.837 

.701 

.020 

6.386 

9 

76 

Soc  ial  Interac*-  ion 

.845 

.714 

.014 

4.538 

10 

360a 

Child  responses,  academic 

.852 

.727 

,012 

4,177 

11 

449a 

Adult  neutral  corrective  feedback,  academic 

,859 

.739 

.012 

4.241 

Third  Grade  (N-57) 


1 

Classroom  mean  F69  WRAT 

.410 

.168 

.168 

11,096 

2 

582c 

Adult  academic  command,  request,  and  direct 

question  to  children 

.642 

.412 

.245 

22,A80 

3 

135 

Large  group  with  any  adults 

.742 

.551 

.139 

16,387 

4 

380a 

Child  self  instructs,  academic,  with  objects 

,785 

.616 

.064 

8.694 

5 

372a 

Child  presents  Information  to  a  group 

.818 

.66'^ 

,053 

8.199 

6 

66 

Numbers,  math,  arithmetic 

.848 

.719 

.050 

8.871 

7 

24 

Child  select  ion 

.872 

.760 

.042 

8.484 

8 

76 

Soc lal  interaction 

.888 

.788 

.028 

6.322 

9 

535c 

Child's  extended  respo.ise  to  question 

.898 

.807 

.019 

4.620 
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Table  123  (Concluded) 


STATISTICS  FROM  THE  STEPWISE  REGRESSION  OF  THE  BASELINE  WRAT 
AND  SELECTED  COI  VARIABLES  ON  THE  OUTCOME  SCORES 


Stez 


Variable 
No. 


Variable  Name 


Dependent  Variable:    MAT  Reading 
First  Grade:  (N-105) 


F70  WRAT 

Total  academic  verbal  Interaction 

Total  weight  In  reading  groups 

Individual  child  response  to  adult  academic 

command,  request,  or  direct  questions 
All  adult  reinforcement  with  tokens 
Child  extended  response,  academic 
Adult  neutral  corrective  feedback,  academic 
Teacher  with  larg**  group 
Adult  with  large  group 


F70  WRAT 

Large  group  with  any  adults 

Child/teacher  and  aide  ratio 

Total  academic  verbal  interaction 

Total  class  duration 

Small  group  with  any  adults 

Child  selection 

Large  group  with  any  adults 


Dependent  Variable;     Ravens    Third  Grade  (N-57) 
F69  WRAT 

Adult  feedback  to  child  response  to  adult 

academic  command  or  question 
Large  group  with  aide 
All  positive  behavior 
Child  corrective  feedback 
All  adult  questions  to  children 
Small  group  of  children  with  any  adult 
Large  group  without  adults 
Total  number  different  resource  categories 

coded  "present"  ovef  three  days 
Child  task-related  comments  to  adults 

Dependent  Variable;    lAR  -  Success    Third  Grade  (N«57) 


0 

JDDC 

J 

163 

493c 

5 

600c 

6 

370a 

7 

449a 

8 

89 

9 

107 

Third 

Grade  (N 

1 

2 

135 

3 

15 

566c 

5 

17 

6 

157 

7 

24 

8 

158 

1 

2 

412a 

3 

150 

4 

593c 

5 

524c 

6 

357a 

7 

111 

8 

185 

9 

44 

10 

519c 

1 

F69  WRAT 

2 

79 

Transitional  activities 

3 

184 

Small  group  without  adults 

4 

145 

Small  group  with  teacher 

5 

157 

Small  gro-ip  with  any  adults 

Dependent  Variable;     lAR  -  Failure    Third  Grade  (N-57) 


1 

2 

138 

3 

bl7c 

4 

15 

5 

515c 

6 

366a 

7 

93 

8 

242 

9 

222 

10 

330a 

11 

135 

12 

159 

F69  WRAr 

Small  group  o£  children  without  adults 
Child  task-related  comments  to  children 
Child/teacher  and  aide  ratio 
Smal'  group  working  together  using  concrete 
objects 

Adult  responds  to  child  question  with  open- 
ended  question 

Aide  with  two  children 

Percentage  of  CCLs  on  which  an  academic 
activity  is  occurring 

Small  group  of  children  with  any  adults 

Child  questions  to  adults 

Large  group  with  any  adults 

One  child  without  adults 
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1 tiple 

RSQ 

F-to- 

R 

p2 
R 

Change 

Entcr 

.708 

.501 

.501 

103.404 

.791 

.625 

.124 

:3.888 

.805 

.648 

.023 

t  47 

.812 

.660 

.012 

3.565 

.825 

.680 

.020 

6.131 

.834 

.696 

.016 

5.012 

.842 

.709 

.014 

4.619 

.849 

.720 

.011 

3.721 

.856 

.733 

..012 

4.415 

.  649 

.421 

.421 

40.016 

.763 

.582 

.161 

20.753 

.787 

.620 

.038 

5.245 

.814 

.663 

.043 

6.681 

.837 

.701 

.038 

6.479 

.866 

.751 

.050 

10.069 

.878 

.772 

.021 

4.452 

.889 

.790 

.018 

4.076 

.  639 

.  408 

.408 

38.584 

.749 

.561 

.153 

19.098 

.  797 

.  635 

.075 

11. 100 

.  835 

.  697 

.062 

10.809 

.  736 

.039 

7.  584 

.  O/  J 

.  761 

.926 

5.467 

.  891 

.  793 

.032 

7.699 

.905 

.819 

.026 

6.903 

.<il9 

.845 

.026 

8.120 

.927 

.858 

.014 

4.485 

.429 

.184 

.184 

12.416 

.594 

.353 

.169 

14.117 

.657 

.432 

.078 

7.319 

.713 

.508 

.077 

8.096 

.755 

.570 

.062 

7.317 

.200 

.040 

.040 

2.285 

.599 

.358 

.319 

26.818 

.698 

.488 

.129 

13.385 

.745 

.555 

.067 

7.792 

.775 

.600 

.045 

5.7V4 

.805 

.648 

.048 

6.855 

.828 

.685 

.037 

5.768 

.859 

.738 

.053 

9.781 

.878 

.771 

.032 

6.622 

.890 

.793 

.022 

4.895 

.901 

.812 

.020 

4.702 

.911 

.830 

.017 

4.463 
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2 .      The  Cooley-Lohnes  Model 

In  addition  to  the  partial  correlations  and  the  stepv;ise  re- 
C^ressions,  the  relationship  of  classroom  processes  and  test  outcomes  was 
furtiier  examined  by  using  a  regression  model  proposed  by  Cooley  and  Lohnes. 
They  formulated  a  model  of  instructional  proces?  components  (see  Cooley 
and  Lohnes)  Evaluative  Inquiry  in  Education ,  in  press,  described  as  "a 
conceptual  scheme  for  guiding  the  development  of  the  instructional  events 
which  take  place  in  classrooms  that  are  related  to  the  kind  and  amount 
of  classroom  learning  that  will  occur."    The  model  synthesizes  and  ex- 
tends the  earlier  work  of  Carroll  (1963),  Glaser  and  Resnick  (1972),  and 
Gagne  (1973).     It  posits  three  factors  as  influencing  criterion  achieve- 
ment:    initial  ability,  time  spent  on  relevant  learning  tasks,  and  in- 
structional efficiency.     The  latter  two  factors  are  the  instructional 
components  found  in  the  classroom.     Each  of  these  instructional  compo- 
nents may  be  further  subdivided. 

Time  spent  on  relevant  learning  tasks  is  a  function  of 

-  Opportunity — the  time  allotted  to  activities  relevant  to 
achievement . 

-  Motivation — the  motivation  of  the  child  to  use  the  time 
allotted. 

Instructional  efficiency  is  a  function  of 

-  The  way  learning  tasks  are  structured  and  the  way  they 
are  selected  or  assigned  to  pupils. 

-  The  nature  and  frequency  of  the  interactions  of  pupils 
with  teachers,  aides,  other  pupils,  and  instructional 
materials.     These  interactions  are  called  instructional 
events. 

A  diagram  of  the  Cooley  and  Lohnes  model  is  presented  in  Fig- 
ure 41.     As  indicated  there,  pupil  ability  is  viewed  as  not  only  affect- 
ing outcome  scores  but  also  as  influencing  the  instructional  process;  e.g., 
the  efficiency  of  instructional  events  is  dependent  on  the  pupils'  initial 
ability.     Cooley  and  Lohnes  do  not  specify  the  detailed  functic  lal  rela- 
tionships among  initial  ability,  instructional  processes,  and  existing 
ability.     This  model  provided  the  conceptual  scheme  for  generating  vari- 
ables for  the  regression  analyses.     The  Cooley  model  was  used  with  two 
separate  sets  of  data  collected  by  SRI.    The  first  set  was  collected  in 
Spring  1972  and  the  analysis  was  reported  by  Emrick  (1974).     (In  this 
report  we  are  discussing  only  the  analysis  for  first  grade.)    The  second 
set  was  collected  in  Spring  ]973  and  is  analyzed  in  the  present  report. 
The  instructional  components  for  the  Cooley  model  and  the  process  variables 
recommended  by  Cooley  which  are  included  in  each  component  are  presented 
in  Table  124.    Cooley 's  selection  of  variables  was  conditioned  primarily 
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INSTRUCTIONAL  PROCESS 


RESULTS 


INITIAL  PUPIL 
ABILITY 


MOTIVATION 


OPPORTUNITY 


STRUCTURE  ANO 
PLACEMENT 


INSTRUCTIONAL 
EVENTS 


Time 
Spent 


EXITING  PUPIL 
ABILITIES 


Instructional 
Efficiency 


FIGURE  41      DIAGRAM  OF  THE  COOLEY  AND  LOHNES  MODEL  OF  INSTRUCTIONAL  PROCESS 
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Table  124 


CLASSROOM  OBSERVATION  VARIABLES  INCLUDED 
IN  EACH  INSTRUCTIONAL  COMPONENT— COOLEY  MODEL 


Instructional 
Process  Component 

Opportunity 
Motivation 


Structure  and 
Placement 


Instructional 
Events 


Variable 
Number 

249 

398a 
403a 
82 

146 

257 

258 

259 

240 
239 
238 
260 

358a 
360a 
406a 
407a 
449a 
41?a 

394a 
396a 


Variable  Name 


Reading,  alphabet,  language  development/ 
longitudinal 

All  adult  praise  to  children 
Adul t  praise,  behavior 

Wide  variety  of  activities,  concurrent,  n e fea t e 

Large  group  with  teacher/reading,  negate'' 
Teacher  with  one  child,  academic  activities/ 
longitudinal 

Aide  with  one  child,  academic  activities/ 
longitudinal 

Volunteer  with  one  child,  academic  activities/ 
longitudinal 

Texts ,  workbooks/ academic  ac tivi ties'' 

Math  or  science  equipment/academic  activities'*^ 

Exploratory  materials/academic  activities" 

Children  independent ,  academic  ac tivities/ 

longitudinal 

All  child  responses 
Child  responses,  academic 

Adult  positive  corrective  feedback,  academic 
Adult  negative  corrective  feedback,  academic 
Adult  neutral  corrective  feedback,  academic 
Adult  feedback,  to  child  responses  to  adult 
academic  commands,  requests,  direct ^questions 
All  adult  ackrowledgment  to  children 
Adult  acknowledgment  to  children,  behavior 


These  variables,  although  similar,  are  not  identical  to  those  used  in  the 
analysis  of  Spring  1972* 


by  the  educational  theory  of  the  Pittsburgh  Individualized  Early  Learn- 
ing Program.     These  variables  were  chosen  a  priori  without  knowledge  of 
the  partial  correlations  or  stepwise  r-^gressions .    As  seen  in  Table  124  , 
four  process  variables  have  definitions  in  the  present  study  that  differ 
slightly  from  those  used  in  the  study  that  was  conducted  on  the  Spring 
1972  data*    The  value  of  each  component  was  found  by  summing  the  values 
of  its  process  variables*     l^ere  indicated  (see  Table  117)  the  negative 
of  the  process  variable  was  used* 
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A  commonality  analysis  approach  was  used  to  assess  both  the 
shared  and  the  unique  predictive  power  of  each  independent  variable  and 
of  each  set  of  independent  variables.     In  commonality  analysis,*  the 
variation  of  the  dependent  variable  is  divided  into: 

(1)  The  unique  variance  that  may  be  predicted  uniquely  by 
each  independent  variable  respectively; 

(2)  The  shared  variance  that  may  be  predicted  by  overlapping 
aspects  of  the  independent  variables;  and 

(3)  The  error  variance,  which  is  not  predictable  by  the 
regression. 

For  the  Cooley  model,  the  independent  variables  were  partitioned 
into  two  groups: 

-  Initial  ability — the  baseline  test  score 

-  The  instructional  process  components. 

Regressions  were  then  run  with:     (1)  the  initial  ability 
alone,   (2)  the  instructional  process  variables  alone,  and  (3)  the  initial 
ability  and  instructional  process  variables  together. 

Emrick  (1974)  diagrammed  the  relationships  between  the  coef- 
ficients of  determination  (R^)  and  the  component  of  variance  in  the 
commanality  analysis  as  shown  in  Figure  42  where  ^1  >        >  and  R^,  repre- 
sent the  coefficients  of  determination  for  the  three  regression  runs, 
respectively.     That  is,  R?  is  the  proportion  of  criterion  variance  ac- 
counted for  by  initial  ability,  Rj  is  the  proportion  of  the  criterion  v 
variance  accounted  for  by  instructional  components,  and  R^  j-  is  the  pro- 
portion of  criterion  variance  accounted  for  by  initial  ability  and  the 
instructional  components.  Then, 


R       -  R  =  the  proportion  of  criterion  variance  due 

^  uniquely  to  initial  ability. 

R^  ^  -  R^  =  the  proportion  of  criterion  variance  due  uniquely 

'  to  the  instructional  components. 

2        2  2 

"       I  ~         proportion  of  criterion  variance  shared  by 

'  initial  ability  and  instructional  components. 

1  -  R^  J-  =  the  proportion  of  criterion  variance  unaccounted 

*  for  (residual  or  error). 


*For  more  details  concerning  commonality  analysis  the  reader  is  referred 
to  Beaton  (1973)  and  to  Mayeske  et  al.  (1969). 
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The  Emrick  analysis  carried  out  using  the  Spring  1972  classroom 
observation  data  was  repeated  as  nearly  as  possible  using  the  data  col- 
lected in  Spring  1973.    First  grade  classrooms  were  the  unit  of  analysis 
in  both  studies.     The  same  posttest  scores  were  u.sed,  and  essentially 
the  same  classroom  observation  variables.    The  pretest  score  used  in  the 
Spring  1972  study  was  the  sum  of  the  Wide  Range  ^Achievement  Test  total 
score,  the  Peabody  Picture  Vocabulary  Test  score,  and  an  item-sampled 
version  of  the  Preschool  Inventory  (PSI)  score.     The  test  battery  was 
changed  and  only  the  baseline  WRAT  score  was  available  for  use  as  a  base- 
line for  the  present  study.     The  sum  of  the  MAT  t.otal  Reading  and  Word 
Analysis  scores  was  used  to  measure  achievement,  ability.    The  first  grade 
sample  used  in  the  1972  study  represented  one  £»i':e  each  for  the  following 
sponsors:     Bank  Street,  University  of  Arizona,  University  of  Georgia, 
University  of  Florida,  and  University  of  Oregon.    All  five  of  the  sites 
included  in  the  1972  sample  were  from  the  southern  and  rural  region  of 
the  United  States  and  they  did  not  have  kindergartens.    The  first  grade 
baseline  data  had  been  collected  when  the  children  entered  school  in 
Fall  1971  and,  therefore,  the  pretest  scores  were  separated  from  the 
posttest  scores  by  only  nine  months.    Thirty  classrooms  were  included. 
The  first  graders  in  the  present  study  represent  25  diverse  geographical 
locations  and  entered  school  as  kindergarteners:  112  classrooms  wer.^  in- 
cluded.    Their  pretest  and  posttest  data  are  separated  by  approximately 
20  months.     Thus  the  pretest  of  the  second  study  might  be  expected  to 
predict  less  criterion  variance  than  the  pretest  of  the  first  study. 

The  means  and  standard  deviations  of  the  predictor  and  criter- 
ion variables  are  summarized  in  Table  125  for  the  30  entering  first 
grades  in  the  1972  classroom  sample  and  the  112  first  grades  (entered 
kindergarten)  in  the  1973  sample.    The  negative  means  for  motivation 
and  structure  and  placement  variables  for  the  1973  sample  resulted  from 
the  inclusion  of  some  observation  variables  which  were  negatively 
weighted. 


Table  125 

MEANS  AiND  SD'S  OF  FIRST  GRADE  MAT  READING  SCORES 


1972  First  Grade        1973  First  Gi;ade 
Variables  '  Mean  SD  Mean  SD 


Predictor  Variables 


Entering  Ability  on  Tests  121.10  14.87  29.60  7.00 

Motivation  12.60  1.16  -     .09  2.10 

Opportunity  .62           .183  .67  .14 

Structure  and  Placement  5.31  2.66  -17.50  18.40 

Instructional  Events  26.40  7.85  28.20  9.30 

Criterion  Variables 

Outcome  Test  Scores  55.80  18.10  67.18  16.00 
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These  results  indicate  that  the  two  samples  are  comparable  only 
in  terms  of  opportunity  and  instructional  events.    The  baseline  test  di- 
mensions are  not  comparable.    Although  the  same  criterion  test  was  used, 
the  1973  sample  of  classrooms  had  higher  scores  than  the  1972  sample. 

The  results  of  ti       agression  analyses  on  the  two  samples  are 
presented  in  Tables  126  and  lz7. 


Table  126 

COEFFICIENTS  OF  DETERMINATION  FOR  THE  REGRESSION  ANALYSES 


1972  First  Grade  1973  First  Grade 

(N  =  30)  (N  =  112)  / 

.46  .53 

.16  .11 


.72  .63 


Table  127 

COMPONENTS  ANALYSIS  OF  FIRST  GRADE  CLASSROOMS 


Percent  of  Total  Criterion 
Variance  Due  to  Source 
Source  of  Variance  1972  (N=30)      1973  (N=112) 


Entering  Ability  (unique)  56  52 

Instructional  process  (unique)  26  10 

Shared  (ability  and  process)  ~  10   1 

Total  accounted  for  72  63 

Error   28  _J7 

Total  100  100 
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R^  (ability) 

Rj  (instructional 
dimensions) 

R^  ^  (total) 


For  the  first  grade  data  collected  in  Spring  1972,  Erarick  (1974) 

reports 


"Interpretation  of  the  results  of  analyses  on  the 
first  grade  sample  was  difficult  because  of  a  neg- 
ative covariance  among  process  and  performance  vari- 
ables.    This  result,  which  is  relatively  rare  in 
educational  data,  tends  to  suppress  the  apparent 
univariate  relationships  of  predictors  to  the 
criterion  and  hence  has  been  labeled  'suppressor 
effect'   (see,  e.g.,  McNemar,  1969,  pp.  210-211). 
Actually,  what  this  effect  indicates  is  a  negative 
shared  commonality.... 

Examination  of  the  intercorrelation  matrix  indicates 
that  although  both  ability  and  process  variables  were 
positively  related  to  the  criterion,  they  tended  to 
be  negatively  related  to  each  other.  Apparently, 
classrooms  in  this  first  grade  sample  in  which  more 
effective  instructional  procedures  were  employed 
tended  zo  be  below  average  on  the  ability  variable, 
thus  yielding  the  observed  interaction.  Neverthe- 
less, the  important  feature  is  the  proportion  of 
criterion  variance  due  uniquely  to  process • vari- 
ables— nearly  26  percent." 

In  spite  of  the  different  baseline  test  battery  used  in  the  two 
studies  and  the  difference  in  time  between  pretest  and  posttests,  the 
variance  accounted  for  by  entering  ability  (unique)  is  similar  for  both 
studies  (see  Table  127).     However,  the  instructional  process  (unique) 
accounts  for  more  than  twice  as  much  of  the  variance  in  the  1972  study 
as  in  the  1973  study.     Shared  ability  and  process  is  a  negative  10%  for 
the  1972  study  and  accounts  for  only  1%  of  the  variance  in  the  1973  study. 
The  percentages  of  variance  accounted  for  by  the  separate  instructional 
component  variables  are  presented  in  Table  128. 


Table  128 

PERCENT  OF  CRITERION  VARIANCE  UNIQUELY  ACCOUNTED  FOR 
BY  EACH  INSTRUCTIONAL  PROCESS  VARIABLE  IN  THE  COOLEY  MODEL 


1972  First  Grade  1973  First  Grade 
 Variables                             (N  =  30)  (N  =  112) 

Motivation  0  2 

Opportunity  17  0 

Structure  and  placement  3  0 

Instructional  events  1  2 
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The  instructional  process  variable  "opportunity"  uniquely 
accounts  for  17%  of  the  criterion  variance  in  the  1972  study  and  for 
none  of  the  variance  in  the  1973  study,    l^ereas  the  combined  instruc- 
tional process  variables  account  for  10%  of  the  criterion  variance  in 
the  1973  study  (see  Table  127),  only  4%  is  accounted  for  (uniquely)  by 
the  sirgle  variables  "Motivation"  and  "Instructional  events"  (see  Table 
128).     This  indicates  that  the  effect  of  the  combined  interaction  of  tne 
process  variables  in  explaining  the  criterion  test  scores  is  greater 
than  the  addition  of  the  percentages  of  the  variances  of  the  single 
process  variables. 

Although  the  percent  of  variance  explained  by  the  unique  com- 
ponents for  instructional  process  variables  are  not  as.  large  in  the  pres- 
ent study  as  those  found  in  the  Emrick  study,  the  percent  of  variance  ex- 
plained is  still  larger  than  most  other  studies  have  reported.    Much  of 
the  research  reporting  "no  effect"  (other  than  entering  ability)  has 
used  such  variables  as  teacher  education,  experience,  or  school  facili- 
ties.    These  results  suggest  that  more  variance  is  explained  when  obser- 
vational data  are  used. 

If  a  secondary  analysis  were  conducted  to  further  capitalize 
on  chance,  a  set  of  variables  which  were  distinguished  in  the  stepwise 
regressions  as  powerful  predictors  (see  Table  129),  could  be  used  in  the 
Cooley-Lohnes  regression  model  and  the  amount  of  variance  accounted  for 
by  the  process  variables  would  probably  increase. 

C.  Summary 

The  results  of  the  partial  correlations,  and  regression  analysis 
suggest  that  what  teachers  do  in  classrooms  may  well  make  a  difference. 
At  least  it  is  clear  that  specific  classroom  processes  can  be  identified 
as  related  to  the  Raven's,  lAR,  MAT,  absence  rate,  and  child  behaviors. 
Inservice  teacher  training  programs  as  well  as  schools  of  education 
might  find  these  results  useful  in  in?tructing  students  in  teaching  prac- 
tices which  might  have  an  impact  upon  the  growth  and  development  of  chil- 
dren.    Essentially,  it  appears  that  in  education  we  get  what  we  pay  for 
(or  emphasize).     In  classrooms  where  reading  and  computation  are  empha- 
sized, the  scores  on  tests  of  reading  and  math  are  higher.     In  classrooms 
where  a  x>^ide  variety  of  activities  and  materials  are  emphasized,  the 
scores  on  the  Raven*s  perceptive  problem-solving  test  are  higher,  and 
children  are  absent  from  school  less  often. 

A  speculation  can  be  made  that  if  math  and  reading  were  emphasized 
part  of  the  day  and  a  wide  variety  of  other  activities  were  offered  for 
the  other  part  of  the  day,  several  dimensions  of  growth  and  development 
might  be  enhanced. 

In  addition,  an  analysis  of  two  process  variables  which  were  par- 
titioned on  the  basis  of  entering  ability  scores  as  judged  by  the  WRAI 
suggests  that  children  in  classrooms  which  have  low  entering  ability 
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mean  scores  may  profit  more  from  a  higher  rate  of  praise  and  more  time 
spent  in  math  than  children  in  classrooms  with  comparatively  higher  en- 
tering ability  mean  scores.    This  study  suggests  the  value  of  examining 
process  variables  to  see  how  they  interact  with  entering  abilities  of 
children.    Such  information  might  maximize  the  learning  program  of  in- 
dividual children. 

Secondary  analyses,  such  as  an  extended  interaction  treatment  study, 
a  crosr-validation  study,  a  factor  analysis  of  process  variables,  or  a 
dimensionality  study  of  process  variables  are  likely  to  yield  more  in- 
formatirn  and  perhaps  a  more  parsimonious  summary  of  the  findings. 


Table  129 


RECOMMENDED  VARIABLES  FOR  USE  IN  COOLEY'S  REGRESSION  MODEL 


Opportunity 


Var.  17 
Var.  2j^3 
Var.  242 


Duration  of  Day 

Approximate  number  of  children  involved  in  reading 
Percent  of  CCLs  in  which  an  academic  activity  is 
occurring 


Motivation 


Var.  402a 
Var.  'i69a 


Adult  praise,  academic 

All  adult  reinforcement  with  tokens 


Structure  and  Placement 


Var.  146 
Var.  240 
Var.  444a 


Large  group  with  teacher 
Text  books  and  workbooks 
Adult  movement 


Instructional  Events 


Var.  441a 

Vat  509c 

Var.  566c 

Var.  449a 


Var.  353a 
Var.  493c 
Var.  412a 


Adult  requests  and  direct  questions,  academic 
Individual  child  response  to  academic  ^/lestions 
Adult  feedback  to  child  response  to  adult  academic 
questions 

Adult  communication  focus — large  group 
Child  self-instruction 
Total  academic  verbal  interactions 
Ne'^tra"*  cor};ective  feedback,  academic 
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CHAPTER  VIII 
SUMMARY 


The  primary  purpose  of  this  report  has  been  to  assess  the  classroom 
implementation  of  the  seven  Follow  Through  sponsors  included  in  the  study. 
An  important  question  continually  raised  by  government  agencies  and  edu*- 
cators  has  been  '*Does  the  Follow  Through  Program  of  Planned  Variations 
exist?"  (i.e.,  are  a  vj^riety  of  educational  programs  being  successfully 
implemented  and  do  these  models  differ  significantly  from  each  other?). 
The  seven  programs  selected  for  study  in  this  analysis  represent  a  wide 
spectrum  of  innovative  educational  theories  represented  in  Follow  Through. 
The  range  includes  two  more  behavioristic  models  (The  University  of  Kansas 
and  the  University  of  Oregon),  a  model  based  upon  the  theory  of  Piaget 
(Kigh/Scope) ,  an  open  school  model  based  upon  English  Infant  School  Theory 
(EDC),  and  three  other  models  which  each  have  their  own  particular  combina 
tions  of  theory  and  practice  drawn  from  Piaget,  Dewey  and  the  English  In- 
fant Schools  (Far  West  Lahoratory,  University  of  Arizona,  and  Bank  Street) 

To  study  sponsor  implementation,  two  questions  were  asked:     (1)  are 
the  individual  models  consistently  implemented  in  accordance  with  the 
sponsor  prestated  philosophies  and  objectives?    and  (2)  do  meaningful 
differences  as  planned  exist  among  the  individual  sponsor  models;  that 
is,  have  the  planned  variations  actually  been  achieved?    A  third  question 
was  asked  which  is  central  to  the  primary  objective  of  the  Follow  Through 
evaluation  "How  are  children  affected  by  the  different  approaches  embodied 
within  these  planned  educational  programs?" 

The  answers  to  these  questions  are  ncu  only  basic  to  the  overall 
evaluation  of  Follow  Through,  but  are  also  of  importance  to  future  plan- 
ning of  educational  intervention  programs.    An  affirmative  answer  to  tne 
first  question  would  help  establish  that  educational  innovations  have 
been  introduced  as  planned  and  that  the  Follow  Through  program  has  met 
its  goal  of  planned  variation.    An  affirmative  answer  to  the  question  of 
implemeniiation  would  help  establish  that  Follow  Through  inodels  are  export- 
able to  other  locations  and  that  the  sponsors  have  established  meaningful 
delivery  'r  ^tems  that  enable  them  to  implement  their  models  consistently 
in  diverse  locations.     Finally,  information  regarding  how  classroom  in*- 
structional  processes  used  in  the  various  programs,  impact  upon  the  growth 
and  development  of  children  is  of  critical  importance  to  all  educators 
who  plan  school  -urograms. 

In  January  1973,  Stanford  Research  Institute  was  authorized  by  the 
U.S,  Office  of  Education  to  extend  its  classroom  observation  activities 
in  order  to  address  these  issues  in  depth.  The  results  and  findings  of 
the  study  are  summarized  in  this  chapter.  These  results  are  based  upon 
data  collected  in  Spring  1973  36  project,  locations.  The  sample  repre- 
sents approximately  20. first  grade  and  20  third  grade  classrooms  for 
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each  of  seven  Follow  Through  sponsors  at  five  or  more  sites  per  sponsor. 
Program  implementation  in  the  classroom  is  judged  on  the  basis  of  two 
criteria:     (1)  the  extent  to  which  a  sponsor's  classrooms  are  found  to 
be  uniform  on  selected  implententation  variables,  and  (2)  the  extent  to 
which  a  sponsor's  classrooms  differ  from  the  traditional  Non- Follow  Through 
classrooms  on  the  same  variables. 


A.      Classroom  Implementation 

1 .      Methodology  Used  in  the  Study  of  Implementation 

The  first  step  in  the  assessment  of    lassroom  implementation 
was  to  describe  eacl:  educational  model  in  det      .     The  model  descriptions 
were  prepared  by  SRI  and  reviewed  by  the  spor       3  and  then  revised  accord- 
ing to  the  sponsor's  spacif ications .     The  sec  ,nd  step  was  to  create  vari- 
ables from  the  codes  used  in  the  observation  instrument  which  would  de- 
scribe representative  elements  of  each  sponsor's  model.     Each  sponsor  was 
sent  the  relevant  variable  list  and  asked  to  rate  each  variable  according 
to:     (1)  its  importance  to  this  model;  and  (2)  the  frequency  with  wh^^ch 
the  variable  was  expected  to  occur  relative  to  a  conventional  class,  lom. 
Thus,  a  list  of  variables  was  selected  for  each  of  the  seven  models. 
These  ranged  in  number  from  31  for  University  of  Oregon  to  55  for  Bank 
Street.    Admiutedly,  the  critical  list  of  variables  only  in  part  describes 
a  sponsor's  model.     Important  subtle  processes  of  some  of  the  programs 
such  as  developing  intrinsic  motivation  have  not  been  assessed.  Reducing 
a  model  to  a  list  of  variables  will  thus  provide  onl^  a  partial  picture 
of  implementation. 

Since  the  Follow  Through  programs  are  intended  to  be  innovative 
and  to  represent  alternatives  to  the  conventional  classroom,  a  pool  of 
Non-Follow  Through  classrooms  was  used  as  the  standard  from  which  Follow 
Through  classrooms  were  expected  to  differ  in  specified  ways.     The  stan- 
dards v;ere  established  separately  for  fir&L  and  third  grades. 

A  non-parametric  scaling  technique**  was  used  in  the  implementa- 
tion analysis.     Implementation  scores  for  each  sponsor  were  determined  by 
rank  ordering  the  Non-Follow  Through  classroom  mean  scores  on  each  sponsor 
variable  and  dividing  the  distribution  into  five  equal  parts.    There  are 

These  sponsors  of  educational  models  were  observed  in  Spring  1973:  Far 
West  Laboratory  for  Educational  Research  and  Development  (5  sites).  Uni- 
versity of  Arizona  (6  sites).  Bank  Street  College  of  Education  (5  sites). 
University  of  Oregon  (5  sites).  University  of  Kansas  (5  sites.  High/ 
Scope  Educational  Research  Foundation  (5  sites),  and  Education  Develop- 
ment Center  (5  sites).     These  sponsors  were  chosen  for  observation 
because  they  met  the  criterion  of  having  five  or  more  sites  being  im- 
plemented . 

"kit 

A  nonparametric  scaling  technique  was  used  rather  than  a  technique*  that 
employs  the  means  and  standard  deviations  of  the  Non-Follow  Through 
classrooms  because  of  the  variety  of  distributions  that  were  encountered 
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35  Non-Follow  through  first  grades.     Beginning  with  lowest  score,  the 
seventh  score  from  the  bottom  is  the  first  quintile  cutpoint;  the  four^ 
teenth  score  is  the  second  quintile  cutpoint;  the  twenty-first  score  is 
the  third  quintile  cutpoint;  and  the  twenty-eighth  score  is  the  fourth 
quintile  cutpoint.    Each  Follow  Through  cla-sroom  falls  within  a  quintile; 
e.g.,  a  classroom  with  a  score  equal  to  or  below  the  seventh  Non-Follow 

rough  classroom  score  is  in  the  first  quintile;  while  a  classroom  with 
a  score  above  the  tw^enty-eighth  Non-Follow  Through  score  is  in  che  fifth 
quintile.     In  Figure  43  the  cutpoints  are  shown  for  the  implementation 
scores  for  the  variable  "Games,  toys,  play  equipment  present"  for  first 
grade  Non-Follow  Through  classrooms. 


Quintiles:  1st  2nd  3rd  4th  5th 


7  NFT 

7  NFT 

7  NFT 

7 

7 

Classroom 

Classroom 

Classroom 

Classroom 

Classroom 

Scores 

Scores 

Scores 

Scores 

Scores 

3.5  4.2  5.1  6.3 

Cutpoint  1    Cutpoint  2    Cutpoint  3    Cutpoint  4 


FIGURE  43      GAMES,  TOYS,  PLAY  EQUIPMENT  PRESENT  (Var.  25)-- 
FIRST  GRADE 


A  sponsor's  implementation  score  on  any  variable  will  always  be 
a  score  between  1  and  5.    This  represents  the  position  of  a  Follow  Through 
classroom  mean  relative  to  the  distribution  of  Non-Follow  Through  means. 

For  each  sponsor's  classroom,  an  implementation  score  was  com- 
puted for  each  of  the  sponsor's  variables.     These  scores  were  displayed 
for  each  variable,  in  the  manner  illustrated  in  Table  130.    A  total  im- 
plementation score  for  a  classroom  was  also  computed  by  dividing  the  sum 
of  the  variable  implementation  scores  by  the  highest  sum  possible^  The 
resulting  proportion  was  then  multiplied  by  100  so  that  it  could  be  ex- 
pressed in  percentage  terms.     To  apply  the  method  in  an  example,  the 
highest  possible  sum  (5)  of  implementation  scores  for  a  hypothetical 


in  the  Non-Follow  Through  classrooms.     The  distributions  ranged  from  the 
familiar  bell  shape  to  a  j-shaped  curve  to  distributions  with  extreme 
outliers.    A  parametric  approach  which  may  be  appropriate  to  one  dis-- 
tribution  may  he  inappropriate  to  another.     The  nonparametric  procedures 
selected  for  use  tend  to  be  less  sensitive  to  these  differences  in  dis- 
tribution than  are  the  more  conventional  parametric  procedures. 
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Table  130 

WIDE  VARIETY  OF  ACTIVITIES,  OVER  ONE  DAY  (Variable  83) 


Sites 


Berkeley,  Calif. 
Duluch,  Minn. 
Lebanon,  N.H. 
Salt  Lake  City,  Utah 
Tacoma,  Wash. 

Total  Classrooms 


First  Grade  Classrooms 
with  Implementation 
Scores  of 


4 
1 
4 
4 

Jl 

17 


Third  Grade  Classrooms 
with  Implementation 
Scores  of 


1 
1 

1 
1 


3 
3 

4 
2 
1 

13 


Percent  of  class- 
rooms 


15%  85% 


15%    20%  65% 
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classroom  being  rated  on  four  variables  would  be  5  x  4  =  20.     If  a  class- 
room had  implementation  scores  of  3,  3,  4,  and  5  on  the  individual  imple- 
mentation variables,  then  the  total  implementation  score  for  the  classroom 
would  be  (15/20)100  -  75%. 

In  order  to  assess  the  magnitude  of  the  total  implementation 
scores  for  Follow  Through  classrooms,  a  total  implementation  score  was 
also  computed  for  each  Non- Follow  Through  classroom  on  each  sponsor's 
set  of  implementation  variables.     The  mean  and  standard  deviation  of  the 
Non-Follow  Through  pooled  classrooms  are  reported  for  each  sponsor  sepa- 
rately for  first  and  third  grades.     One-tailed  t- tests  were  computed  to 
test  for  the  significance  of  the  differences  between  each  Follow  Through 
sponsor's  classrooms  and  the  Non-Follow  Through  classrooms. 

2 .      Results  of  the  Classroom  Implementation  Study 

Total  implementation  scores  for  each  classroom  for  each  sponsor 
are  presented  in  Tables  131  through  137.     The  means  and  standard  devia- 
tions are  presented  by  grade  level,  based  on  the  scores  for  all  of  a 
sponsor's  classrooms  in  each  site  and  also  for  pooled  Non-Follow  Through 
classrooms . 

The  Far  West  classrooms  in  both  first  and  third  grades  are 
remarkably  similar  within  sites  and  between  sites  on  total  implementation 
scores,  with  the  greatest  within-site  deviation  found  in  the  third  grade 
in  Duluth  (see  Table  131).    Although  12%  of  the  children  in  Salt  Lake  City 
did  not  speak  English  as  a  first  language,  both  grade  levels  have  high 
implementation  scores.    Overall,  the  Far  West  classrooms  at  both  first  and 
third  grades  are  significantly  different  from  the  Non-Follow  Through  class- 
rooms when  compared  on  Far  West  implementation  variables* 

There  is  a  significant  difference  between  the  total  implementa- 
tion scores  in  the  first  and  third  grade  of  university  of  Arizona  class- 
rooms  and  the  Non-Follow  Through  comparison  classrooms  (see  Table  132). 
The  results  of  an  analysis  of  variance  indicate  that  there  is  a  greater 
difference  among  University  of  Arizona  sites  than  there  is  within  the 
sites.     The  greatest  difference  in  the  first  grade  is  found  between 
Lincoln,  with  a  mean  of  83,  and  Newark,  with  a  mean  of  55.    While  the 
first  grade  at  Newark  shows  little  deviation  within  the  classrooms  at 
the  site,  the  total  implementation  scores  for  first  grade  are  lower  than 
that  of  the  Non-Follow  Through  classrooms.    Newark  third  grades  also  had 
low  implementation  scores.     It  must  be  noted  that  Newark  had  more  fami- 
lies below  poverty  level  than  other  sites  and  the  sponsor  rep^'rted  some 
staffing  problems*    The  other  five  University  of  Arizona  sites  (excepting 
Des  Moines  third  grade)  have  implementation  scores  which  are  at  least  ten 
points  higher  than  the  Non-Follow  Through  scores. 


Four  dimensions  of  observational  reliability  were  examined  in  this  re- 
port; anomalies  and  completeness  of  data  collection,  day  to  day  reli- 
ability, conf usability  of  codes  and  observer  reliability.     On  each 
dimension  the  data  were  found  to  be  acceptably  reliable. 
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Table  131 


TOTAL  SITE  IMPLEMENTATION  SCORES  FOR  FAR  WEST  MODEL 


First  Grade 


Sites 

Classroom 

Scores 

Site 

Scores 

1 

2 

3 

4 

X 

S.D. 

Berkeley 

(EK) 

72.6% 

79.3% 

75.6% 

71.9% 

7  A.  8% 

3.4 

Duluth 

(EK) 

76.3 

8A.A 

80.7 

80.0 

80.4 

3.3 

Lebanon 

(EK) 

81.5 

75.6 

8A.A 

80.7 

80.6 

3.7 

Salt  Lake  City 

(EK) 

80.7 

85.9 

75.6 

80.0 

80.6 

4.2 

Tacoma 

(EK) 

78.5 

71.9 

78.5 

71.1 

75.0 

4.1 

Sponsor  Scores  (N  = 

20): 

78.3% 

4.4 

NFT  Scores  (N 

=35): 

60.3 

6.3 

t  =  11.28 
p  <  .001 
F  =  2.65 
p  <  NS 


Sites 

Third 

Grade 

Classroom 

Scores 

Site 

Scores 

1 

2 

3 

4 

X 

S.D 

Berkeley  (EK) 

82.2% 

70.4% 

79.3% 

71.9% 

75.9% 

5.7 

Duluth  (EK) 

74.1 

61.5 

80.0 

71.1 

71.7 

7.7 

Lebanon  (EK) 

69.6 

77.8 

74.1 

64.4 

71.5 

5.8 

Salt  Lake  City  (EK) 

84.4 

89.6 

76.3 

85.2 

83.9 

5.6 

Tacoma  (EK) 

79.2 

84.4 

80.7 

72.6 

79.2 

5.0 

Sponsor  Scores  (N= 

20)  : 

76.4% 

7.2 

NFT  Scores  (N=36): 

59.0 

9.4 

t  •»  7.18 
p  <  .001 
F  «  3.07 
p  <  .05 
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Table  132 


TOTAL  SITF  IMPLEMENTATION  SCORES  FOR  UNIVERSITY  OF  ARIZONA  MODEL 


First  Grade 


Sites 

Classroom 

Scores 

Site 

^  1. 

1 

2 

3 

4 

S.D. 

Des  Moines  (EK) 

79.0% 

62.9% 

69.5% 

71.4% 

70.7% 

6.7 

Fort  Worth  (El) 

85.7 

78.1 

70.5 

75.2 

77.4 

6.4 

I.aFayette  (El) 

79.0 

71. A 

87.6 

79.4 

8.1 

Lake wood  (EK) 

78.1 

7A.3 

76.2 

79.0 

76.9 

2.1 

Newark  (EK) 

57.1 

54.0 

56.2 

54.3 

55.4 

1.5 

Lincoln  (EK) 

89.5 

88.6 

74.3 

81,0 

83,3 

7.1 

Sponsor  Scores 

(N=23): 

73.6% 

10.7 

NFT  Scores  (N= 

35): 

61.8 

7.0 

t  «  4.99 

p  <  .001 

F  =•  11.76 

p  <  .001 


Sites 

Third 

Grade 

Classroom 

Scores 

Site 

Scores 

1 

2 

3 

4 

S.D. 

Des  Moines  (EK) 

65.7% 

52.4% 

53.3% 

75,2% 

61.7% 

10,9 

Fort  Worth  (El) 

66,7 

80.0 

82.9 

84,8 

78.6 

8.2 

LaFayette  (El) 

68,6 

71.4 

73,3 

87,6 

75.2 

8,5 

Lakewood  (EK) 

76,2 

78.1 

76,2 

73.3 

76.0 

2.0 

Newark  (EK) 

61,9 

63.8 

67.6 

63.8 

64.3 

2.4 

Lincoln  (EK) 

77.1 

75.2 

78.1 

81.9 

78.1 

2.8 

Sponsor  Scores 

(N=24): 

72,3% 

9.1 

NFT  Scores  (N= 

36): 

60.7 

9.3 

t  =  4.77 
p  <  .001 
F  -  4.75 
p  <  .01 
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The  Bank  Street  first  and  third  grade  classrooms  are  similar  in 
total  implementation  scores  both  within  and  among  sites  (see  Table  133). 
The  greatest  deviation  is  found  among  third  grade  classrooms  in  Tuskegee 
(8.1)  and  among  Fall  River  first  grade  classes  (7.5).    The  classrooms  in 
Tuskegee  are  scattered  over  a  large  county  area  and  consistency  among 
classroom  processes  may  be  hard  to  obtain;  however,  first  grades  limited 
to  one  school  had  less  variation.     In  Fall  River,  which  has  a  large 
Portuguese  population,  34%  of  the  children  do  not  speak  English  as  a 
first  language;  however,  there  is  a  large  standard  deviation  between 
classroom  nieans  (23).     Some  of  the  classrooms  may  have  many  Portuguese- 
speaking  children  while  other  classrooms  may  have  few  such  children, 
and  such  differences  may  affect  implementation  if  the  teacher  has  diffi- 
culty in  understanding  the  children  or  making  herself  understood.    As  can 
be  seen  on  Table  127,  three  out  of  the  four  first  grade  classrooms  in 
Fall  River  have  implementation  scores  considerably  higher  than  Non-Follow 
Through.    Whether  or  not  the  classroom  with  a  low  implementation  score 
also  has  more  children  who  do  not  use  English  as  a  first  language  has  not 
been  investigated.    The  mean  of  the  Bank  Street  Implementation  scores  is 
significantly  higher  than  the  Non-Follow  Through  score.     Only  Philadelphia 
third  grades  have  a  mean  score  close  to  the  Non-Follow  Through  mean  score. 
1972-1973  was  a  difficult  year  for  sponsors  to  work  in  Philadelphia  due 
to  two  major  teacher  strikes. 

As  the  t  test  on  Table  134  indicates,  overall  the  University 
of  Oregon's  classrooms  are  significantly  different  from  the  Non-Follow 
Through  classrooms.    No  first  grade  classrooms  and  only  one  third  grade 
Oregon  classroom  score  is  below  the  mean  of  Non-Follow  Through. 

The  analysis  of  variance  F  tests  which  are  presented  on  Table 
134  indicate  that  the  among-site  variance  is  greater  than  the  within-site 
variance  in  the  first  grade.     The  greatest  difference  is  seen  between  New 
York  and  Racine.     In  the  third  grade  the  variance  is  as  great  within  the 
sites  as  among  sites.     The  difference  in  New  York  is  particularly  great 
where  one  third  grade  classroom  has  a  low  score  of  57.6  and  another  has 
a  high  score  of  81.2.    A  possible  explanation  may  be  that  children  in 
University  of  Oregon's  New  York  third  grades  have  had  fewer  months  in 
Follow  Through  and  the  attrition  rate  is  greater  than  for  other  sites. 
The  standard  deviation  for  third  grades  in  St.  Louis  and  Racine  is  also 
high.    The  standard  deviation  for  the  first  grades  at  these  same  sites 
is  considerably  less.     One  possible  explanation  for  the  difference  among 
third  grade  classrooms  might  be  that  in  the  spring  of  the  year  when  ob- 
servations are  conducted,  teachers  might  be  preparing  the  children  for 
the  fourth  grade  Non-Follow  Through  classrooms  and  they  might  not  be  ad- 
hering so  strictly  to  University  of  Oregon's  stated  program.    Note,  this 
rationale  could  also  apply  to  other  sponsors,  as  well,  since  there  is  a 
slight  trend  toward  lower  implementation  scores,  and  more  deviation  among 
them,  in  the  third  grade  for  several  other  sponsors. 

The  t  test  presented  on  Table  135  indicates  that  the  University 
of  Kansas  classrooms  differ  from  the  Non-Follov;  Through  classrooms.  Only 
one  first  grade  Kansas  City  classroom's  implementation  score  (64.7)  is 
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Table  133 


TOTAL  SITE  IMPLEMENTATION  SCORES  FOR  BANK  STREET  MODEL 

First  Grade 


Classroom  Scores  Site  Scores 


Sites 

1 

I 

3 

4 

X 

S 

D. 

Brattleboro 

(EK) 

6A. 

A% 

74 

1% 

68. 

9% 

% 

69. 

1% 

4 

8 

Fall  River 

(EK) 

80. 

7 

75 

6 

71. 

1 

63 

0 

72 

6 

7 

5 

NYC  P.S.  2A3K 

(EK) 

78. 

5 

74 

.8 

77. 

0 

67 

4 

74. 

4 

4 

9 

Philadelphia  II 

(EK) 

77 

8 

82 

.6 

78. 

5 

77 

.0 

79. 

0 

2 

5 

Tuskegee 

(El) 

80 

0 

78 

.5 

75 

6 

76 

.3 

77 

6 

2_ 

■A 

Sponsor  Scores 

(N= 

19): 

74 

8% 

5 

.5 

NFT  Scores  (N= 

35): 

62 

.7 

6 

.2 

t  ■=  7.12 

p<  .001 

F  =  2.37 

p  <  NS 


Third  Grade 


Classroom  Scores    Site  Scores 


Sites 

] 

L 

I 

3 

4 

X 

S_ 

.D. 

Brattleboro 

(EK) 

75 

.6% 

74 

8% 

71. 

1% 

% 

73. 

8% 

2 

.4 

Fall  River 

(EK) 

61 

5 

68 

9 

68. 

9 

71.1 

67. 

6 

4 

.2 

NYC  P.S.  243K 

(EK) 

62 

2 

68 

9 

77. 

8 

69.6 

69. 

6 

6 

.4 

Philadelphia  II 

(EK) 

63 

0 

65 

2 

60. 

0 

70.4 

64. 

6 

4 

.4 

Tuskegee 

(El) 

70 

4 

81 

5 

77. 

0 

63.0 

73. 

0 

8_ 

.sor  Scores 

(N=19) 

69. 

5% 

6 

0 

1       Scores  (N= 

36)  : 

62. 

4 

8 

6 

t  =  3.20 

p  <  .001 

F  1.71 

p  <  NS 
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Table  134 

TOTAL  SITE  IMPLEMENTATION  SCORES  FOR  UNIVERSITY  OF  OREGON  MODEL 


First  Grade 


Sites 

Classroom  Scores 

Site 

Scores 

1 

2 

3 

4 

X 

S.D. 

E.  St.  Louis  (EK) 

76.2% 

62.5% 

76.2% 

75.0% 

7^.5% 

6.7 

NYC  P.S.  137K  (EK) 

88.7 

90.0 

91.2 

90.0 

1.3 

Racine  (EK) 

72.5 

72.5 

71.2 

71.2 

71.9 

.7 

Tupelo  (El) 

80.0 

86.2 

87.5 

87.5 

85.3 

3.6 

Providence  (EK) 

72.5 

77.5 

72.5 

73.7 

7A.1 

2. A 

Sponsor  Scores  (N= 

19): 

78.2% 

8.1 

NFT  Scores  (N=35): 

61.0 

10.7 

t  =  6.11 

P<  .001 

F  =  17.61 

p<  .001 


Third  Grade 


Sites 

Classroom  Scores 

Site 

Scores 

1 

2 

3 

4 

X 

S.D. 

E.  St.  Louis  (EK) 

76.5% 

62.4% 

78.8% 

87  . 1% 

76.2% 

10.3 

NYC  P.S.  137K  (EK) 

68.2 

81.2 

57.6 

69. a 

11.8 

Racine  (EK) 

71.8 

62.4 

84.7 

85.9 

76.2 

11.2 

Tupelo  (El) 

87.1 

80.0 

90.6 

74.1 

82.9 

7.3 

P'-ovidence  (EK) 

75.0 

82.4 

78.8 

69.4 

76.4 

5.5 

Sponsor  Scores  (N=19): 

76.5% 

9.3 

NFT  Scores  (N=36): 

60.4 

10.5 

t  =  5.62 

p<  .OGl 

F  =  .91 

p  <  NS 
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Table  135 


TOTAL  SITE  IMPLEMENTATION  SCORES  FOR  UNIVERSITY  OF  KAN3AS  MODEL 

First  Grade  


Classroom  Scores   Site  Scc'es 


Sites 

1 

2 

3 

A 

X 

S.D. 

NYC  P.S.  7  7X 

"7  ^  fW 

Q  1 

J/» 

% 

V 

78  1% 

A .  A 

Philadelphia  VI 

(EK) 

78.8 

90. 

6 

82. 

A 

88,2 

85.0 

5. A 

Portageville 

(EK) 

96.5 

91. 

8 

90 

.6 

88.2 

91.8 

3.5 

Kansas  City 

(EK) 

82. A 

7A. 

1 

83 

.5 

6A.7 

76.2 

8.7 

Louisville 

(EK) 

85.9 

90. 

92 

.9 

85.9 

88.8 

3.5 

Sponsor  Scores 

(N= 

18): 

8A.6% 

7.9 

NFT  Scores  (N^ 

35): 

62.  A 

8.!) 

t  -  9. 

22 

P  <  • 

001 

F  =  5. 

lA 

P  <  . 

01 

Third  Grade 


Classroom  Scores    Site  Scores 


Sites 

_1_ 

2 

3 

A 

X 

S.D. 

NYC  P.b.  77X 

(EK) 

71.2% 

85. 

0% 

% 

% 

78.1% 

9.7 

Philadelphia  VI 

(EK) 

76.5 

82. 

A 

75.3 

8A.7 

79.7 

A. 5 

Portageville 

(EK) 

89.  A 

7A. 

1 

78.8 

80.8 

7.8 

Kansas  City 

(EK) 

88.2 

88. 

2 

8A.7 

8A.7 

86.5 

2.0 

Louisville 

(EK) 

88.2 

91. 

8 

87.1 

85.9 

88.2 

2.5 

SooiTsor  Scores 

(N= 

17): 

83.3% 

6.0 

NFT  Scores  (N= 

36): 

61.3 

9.3 

t  =  8. 

89 

P  <  . 

001 

F=  2. 

53 

p  <  NS 

337 


close  to  the  Non-Follow  Through  score  (62.4).    All  other  University  of 
Kansas  classroom  scores  are  in  the  70s,  80s,  or  90s.    The  analysis  of 
variance  indicates  that  in  the  first  grade  there  is  a  greater  difference 
among  site  implementation  mean  scores  than  there  is    within  sites. 
Portageville  has  the  highest  mean  score  (92)  and  Kansas  City  the  lowest 
(76).     Kansas  City  also  has  the  greatest  within-site  variance  (8.7).  The 
one  classroom  mentioned  above  with  the  62.4  score  seems  to  account  for 
this  variance.     In  the  third  grade  the  greatest  variance        found  between 
the  two  classrooms  in  New  York.     The  least  variation  and  the  highest  itn 
plementation  scores  for  third  grades  are  found  within  Kansas  City  and 
Louisville. 

The  t  test  presented  on  Table  136  indicates  that  overall  the 
High/Scope  implementation  mean  score  differs  from  the  Non-Follow  Through 
mean  score.     Only  the  classrooms  in  the  New  York  third  grades  have  im- 
plementation scores  similar  to  those  in  Non-Follow  Through.    New  York 
also  has  the  lowest  first  grade  implementation  scores.     The  primary 
difference  between  New  York  and  the  other  High/Scope  sites  is  geographic 
in  nature;  New  York  City  is  the  only  large  eastern  urban  center  included 
in  the  High/Scope  sample  projects.     There  is  little  variability  within 
or  among  site  mean  scores.     In  no  case  is  the  within-sd  .e  variance 
greater  than  3.8  (Greenwood  first  grades)  and  in  Greeley  the  variance 
among  first  grades  is  only  .8.    This  is  remarkable  since  in  Greeley  27% 
of  the  children  speak  English  as  a  second  language  and  the  attrition 
rate  is  high.     These  figures  reflect  a  migrant,  Spanish-speaking  popula- 
tion, and  indicate  that  the  teachers  have  been  able  to  implement  the 
model  in  spite  of  the  difficulties  which  might  arise  when  children  speak 
languages  other  than  the  language  used  in  school.    Greenwood,  which  had 
a  considerably  lower  per  capita  income  than  other  High/Scope  sites,  was 
also  welJ  implemented. 

The  t  tests  presented  on  Table  137  indicate  that  the  EDC  class- 
room means  are  different  statistically  from  the  Non-Follow  Through  class- 
rooms in  both  the  fitbL  and  third  grades.     In  the  third  grade  the  overlap 
of  EDC  classroom  scores  with  Non-Follow  Through  is  not  so  great.     In  first 
grade,  two  classrooms  have  scores  lower  than  the  Non-Follow  Through  uxean 
score,  and  in  third  grade  only  one  EDC  classroom  has  a  score  lower  than 
the  Non-Follow  Through  mean  score. 

The  analysis  of  variance  shows  that  the  variability  among  sites 
is  statistically  significant  relative  to  the  within-site  variance  in  both 
first  and  third  grades.     Burlington  has  a  score  of  90  in  the  first  grade 
and  Rosebud  a  score  of  82  in  the  third  grade.     Philadelphia  has  the  lowest 
scores,  65  and  68,  and  contributes  most  of  the  variance  for  both  first  and 
third  grades.    Not  only  are  Philadelphia  implementation  scores  lower 
than  those  of  other  sites,  their  within-site  variation  is  greater.  Here 
again,  the  low  implementation  scores  and  variability  might  be  explained 
by  two  prolonged  teacher  strikes  in  Philadelphia.     It  is  possible  that 
when  tension  is  high,   teachers  may  become  more  structured  and  adhere  less 
to  the  theory  of  the  model.     It  must  be  noted  that  all  other  sites  have 
high  implementation  scores  and  low  within-site  variance. 
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Table  136 


TOTAL  SITE  IMPLEMENTATION  SCORES  FOR  HIGH, SCOPE  MODEL 


First  Grade 


Classroom  Scores  Site  Scores 


Sites 

1 

2 

3 

4 

X 

S.D. 

Greenwood  (El) 

71.0% 

67.6% 

70.3% 

76.  6% 

71.4% 

3.8 

Ft.  Walton  Beach(El) 

77.9 

73.8 

79.3 

75.9 

76.7 

2.4 

NYC  P.S.  92M  (EK) 

66.2 

71.7 

71.0 

69.7 

3.0 

Greexey  (EK) 

82.8 

81. A 

82.8 

82.3 

.8 

Denver  (EK) 

86.9 

80.7 

80.7 

82.8 

82.8 

2.9 

Sponsor  Scores  (N=18) 

76.6% 

6.0 

NFT  Scores  (N=35) : 

63.7 

5.8 

t  =  7. 

58 

P  >  . 

001 

F=  15.59 
p  >  .001 


 Third  Grade  

Classroom  Scores    '  Site  Scores 


Sites 

1 

2 

3 

I 

X 

S.D. 

Greenwood 

(El) 

70.3% 

7  3.1% 

75.2% 

Ik 

5% 

7  3.3% 

2.1 

Ft.  Walton  Beach 

(El) 

83.4 

83.4 

80.7 

78 

6 

81.6 

2.3 

NYC  P.S.  92M 

(EK) 

66.9 

62.1 

64.8 

64 

8 

64.7 

2.0 

Greeley 

(EK) 

80.0 

80.0 

86.2 

82.1 

3.6 

Denver 

(EK) 

73.1 

71.7 

78.6 

76 

6 

75.0 

3.2 

Sponsor  Scores 

(N=19) 

75.0% 

6.9 

NFT  Scores  (N= 

36): 

• 

63.5 

6.8 

t  =  5.93 
p  >  .001 
F=  27.34 
p  >  .001 
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Table  137 

TOTAL  SITE  IMPLEMENTATION  SCORES  FOR  EDC  MODEL 


First  Grade 


Classroom  Scores 

Site 

Scores 

Sites 

1 

2 

3 

4 

_i_ 

S.D. 

Burlington 

(EK) 

91. 

0% 

91.0% 

86.0% 

93.0% 

90.2% 

3.0 

Philadelphia 

IV  (EK) 

72. 

0 

80.0 

58.0 

48.0 

64.5 

14.3 

Paterson 

(EK) 

70. 

C 

79.0 

79.0 

73.0 

75.2 

4.5 

Rosebud 

(EK) 

72. 

0 

68.0 

71.0 

70.3 

2.1 

Smithfield 

(El) 

85. 

0 

76.0 

86  C 

Cj.O 

82.5 

4.5 

Sponsor  Sco 

res  (N= 

19): 

76.9% 

11,5 

NFT  Scores 

(N"35) : 

61.2 

9.8 

t  =  5.35 
p  >  .001 
F  =  7.26 
p  >  .01 


Third  Grade 


Sites 

Classroom  Scores 

Site 

Scores 

1 

2 

_3  

4 

S.D. 

b-  ^lingtc  ;  (EK) 

85.5% 

81.8% 

79.1% 

75.5% 

80.5:", 

4.2 

Philadelphia  IV  (EK) 

75.5 

64.5 

73.6 

59.1 

68.2 

7.7 

Paterson  (EK) 

67.3 

69.1 

77.3 

73.6 

71.8 

4.5 

Ro.«ebud  (EK) 

85.5 

80.0 

79.1 

81.5 

3.4 

S"-ii:hfield  (El) 

76.4 

79.1 

77.7 

1.9 

Sponsor  Scores  (N='17): 

75.4% 

7.1 

NFT  Scores  (N=36) : 

60.7 

10.6 

t  =  5.18 
p  >  .001 
F  =  4.54 
>  .05 
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B.      Sponsor  Differences 
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Differences  among  sponsors  were  examined  through  discriminant  func- 
tion analysis.    The  discriminant  functions  on  which  sponsors  differed 
were  dominated  by  one  or  two  very  specific  classroom  process  variables, 
e.g.,  ''Large  group  with  aide/Math*'  or  "Adult  reinf orcemen*-    \th  token, 
academic."    Three  groups  of  classrooms  were  usually  found  ii.  these  analy- 
ses.    Those  classrooms  using  the  University  of  Kansa-   model  formed  a 
cluster,  those  using  the  University  of  Oregon  model  formed  another  clus- 
ter,   and  classrooms  of  the  remaining  five  sponsors  formed  several  dif- 
ferent clusters. 

In  an  effort  to  see  more  clearly  how  the  five  sponsors  are  distin- 
guished from  each  other,  a  separate  analysis  was  conducted  without  the 
data  from  University  of  Kansas  and  University  of  Oregon.     In  this  analysis, 
the  University  of  Arizona  was  distinguished  from  the  remaining  four  spon- 
sors on  the  basis  of  "Child's  extended  response  to  questions"  and  "Adult 
communication  or  attention  focus,  small  group."    High/Scope  was  differen- 
tiated from  the  other  four  on  f.he  basis  o*"  variables  indicating  a  high 
level  of  verbal  interaction  between  adults  and  children  and,  as  would  be 
expected  from  their  Piagetian  model,  "Child  self-instruction,  objects." 
The  third  discriminant  function  distinguished  Far  West  Lab  from  EDO  and 
Bank  Street,  in  that  Far  West  had  a  higher  mean  score  for  "All  adult 
praise  to  children,"  and  less  academic  instruction  than  did  the  other 
two  sponsors. 

An  analysis  was  also  made  to  see  if  classrooms  could  be  classified 
by  sponsor.    Based  on  Classroom  Observation  data,  out  of  a  total  of  524 
classifications  using  CCL  variables  and  FMO  variables,  410  were  correct. 
University  of  Kansas  and  University  of  Oregon  classrooms  were  rarely  mis-- 
classified  as  belonging  to  another  sponsor.    The  classrooms  of  the  remain- 
ing five  sponsors  are  occasionally  confused  with  each  other  but  only 
rarely  with  the  University  of  Oregon  or  University  of  Kansas  models. 
Three  High/Scope  classrooms  were  classified  as  belonging  to  University  of 
Oregon  and  two  were  classified  as  University  of  Kansas  classrooms.     In  the 
majority  of  cases,  however,  classroom^  .affiliated  with  a  particular  spon-- 
sor  were  correctly  identified  with  tbat  sponsor  and  we  conclude  that  for 
the  most  part,  sponsors  can  be  distinguished  by  the  obsen^at-.ion  variables 
used  in  this  analysis. 

In  order  to  learn  more  about  the  type  of  processes  used  in  the  Non- 
Follow  Through  classrooms,  their  scores  on  the  critical  variables  were 
also  assessed  to  see  how  they  would  be  classified  in  the  sponsors'  groups. 
Few  Non-Follow  Through  classrooms  were  classified  as  University  of  Kansas 
classrooms  in  either  grade  level.    They  were  most  often  classified  as  EDC 
in  the  first  grade  and  as  University  of  Oregon  in  the  third  grade,  on  the 
grouping  and  activity  variables.    On  the  interaction  variables,  the  Nor - 
Follow  Through  classrooms  were  distributed  rather  evenly  across  Far  West, 
University  of  Arizona,  Bank  Street,  University  of  Oregon,  High/Scope,  and 
EDC. 


341 


C.      Teacher  Reports 


In  the  study  of  implementation  it  is  important  to  try  to  understand 
what  methods  or  strategies  sponsors  employed  to  bring  about  the  changes 
in  teacher  behavior  and  which  teacher  characteristics  are  related  to 
classroom  implementation.     The  evaluation  of  classroom  conformity  to 
sponsor  goals,  described  above,  leaves  no  doubt  that  implementation  of 
tne  Follow  Through  models  has  taken  place  in  many  diverse  sites. 

An  effort  was  made  to  determine  (1)  which  elements  in  the  sponsor's 
inservice  teacher  training  program  were  effective  in  the  implementation 
process,  and  (2)  which  teacher  characteristics  might  be  related  to  suc- 
cessful implementation.     items  from  the  Follow  Through  Ttacher  Question- 
naire regarding  the  sponsor's  teacher  training  program,  teaching  experi- 
ence, education,  satisfaction  with  the  sponsor's  model,  and  a  report  of 
classroom  structure  were  analyzed.    Unfortunately,  the  correlations  from 
these  analyses  were  very  low  and  the  findings  do  not  warrant  a  discussion 
in  this  report.*    Only  an  analysis  of  classroom  structure  reported  by 
teachers  on  the  questionnaire  is  analyzed  in  their  report. 

Structure  of  Classroom — Teachers*  descriptions  of  the  extent  of 
structure  in  their  classrooms  were  quite  distinct.    A  low  score  on  the 
scale  indicated  greater  structure,  while  a  high  score  indicated  flexibil- 
ity.   For  each  sponsor,  teacher  reports  of  classroom  practices  conformed 
closely — to  each  other  and  to  the  requirements  of  the  sponsor's  model. 

The  influence  of  the  sponsors  is  apparent  because  (1)  there  was 
little  deviation  among  the  teachers'  reports,  and  (2)  the  more  structured 
models  (University  of  Oregon  and  University  ,if  Kansas)  were  lower  on  the 
scale  and  the  more  flexible  models  were  higher  on  the  scale.  Non-Follow 
Through  separates  these  two  groups,  but  does  not  overlap  with  them. 


D.      Classroom  Instructional  Processes  and  Child  Outcomes 

Using  105  first  grade  and  58  third  grade  Follow  Through  and  Non- 
Follow  Through  classrooms  for  whom  baseline  test  data  were  available, 
partial  correlations  were  computed  using  classroom  means  for  instructional 
processes  on  the  following:     selected  child  behaviors,  absence  rate,  and 
test  scores.  • 

In  both  first  and  third  grades,  the  tendency  is  for  higher  reading 
and  math  scores  to  be  associated  with  variables  which  describe  the  more- 
structured,   teacher-initiated  classrooms. 


It  is  the  opinion  of  the  authors  that  a  more  useful  study  of  teacher 
training  would  require  specific  information  regarding  training  procedures 
used  by  the  sponsors  beyond  that  reported  in  the  Teacher  Questionnaire. 
The  training  procedures  of  sponsors  may  be  obtained  from  the  individual 
sponsors . 
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There  is  a  significant  relationship  between  high  test  scores  and 
small  group  instruction  for  first  grade,  but  large  group  instruction 
for  third  grade. 

A  significant  correlation  was  found  between  test  scores  and  stimulus- 
response-feedback  interactions,  where  the  teacher  provides  a  bit  of  infor- 
mation and  asks  a  question  about  the  information.    The  child  responds, 
and  the  teacher  immediately  lets  the  child  know  whether  the  response  is 
right  or  wrong.     If  he  is  wrong,  the  child  is  guided  to  the  correct  answer 
(positive  corrective  feedback).    If  he  is  correct,  he  receives  praise,  a 
♦-oken,  or  some  form  of  acknowledgment,     "^is  positive  reinforcement  is 
significantly  related  to  the  test  score©. 

Self-instruction  and  task  persistence  are  correlated  with  reading  and 
math  achievement.  Also,  in  classes  where  social  studies  are  taught,  there 
is  a  positive  relationship  with  reading  scores.  Ob>^iously,  reading  skills 
are  used  in  social  studies  projects,  but  it  is  of  interest  to  note  that 
occurrence  of  the  activity  is  related  to  reading  scores.  In  addition, 
the  use  of  instructional  materials  such  as  programmed  material,  Cuisenaire 
rods,  or  Montessori  materials  are  positively  correlated  with  math  scores. 

Variables  describing  the  time  per  child  spent  in  reading  or  math 
activity  (either  formal  or  informal)  were  highly  correlated  with  math  and 
reading  achievement.    A  study  of  entering  ability  indicated  that  amount  of 
time  spent  in  math  was  more  closely  related  to  achievement  in  third  grade 
classrooms  where  the  entering  ability  had  been  lower  than  in  classrooms 
where  the  entering  ability  had  been  higher.    The  study  of  the  relationship 
of  praise  to  achievement  in  math  Indicated  similar  findings.    Thl'j  type 
of  interaction  treatment  study  could  be  useful  in  planning  educational 
programs  to  enhance  the  learning  of  children  with  differing  abilities 
and  different  age  levels.    University  of  Oregon  and  University  of  Kansas, 
both  structured  models,  have  the  highest  scores  of  all  sponsors  in  first 
grade  reading,  and  University  of  Kansas  has  the  highest  score  in  first 
grade  math.     In  third  grade,  the  University  of  Oregon  has  the  highest 
residual  gain  score  of  all  sponsors  in  both  reading  and  math. 

In  general,  a  low  absence  rate,  high  independence,  and  high  scores 
on  Raven's  Coloured  Progressive  Matrices,  a  test  of  non-verbal  perceptual 
problem-solving,  tend  to  be  associated  with  the  more  flexible  classroom 
where  a  wide  variety  of  materials  are  used,  many  different  activities 
occur,  and  children  are  allowed  to  select  their  own  groups  and  seating 
part  of  the  time.     In  these  more  flexible  classrooms^  ar ilts  interact 
with  children  on  a  one- to-one  basis,  more  open-ended  questions  are  asked, 
and  children  show  more  verbal  initiative.    Far  West,  University  of  Arizona, 
Bank  Street,  High/Scope,  and  Educational  Development  Committee,  use  these 
processes.    For  the  most  part,  childreji  ia  these  classronms  have  higher 
scores  on  the  Raven's,  lower  absence  rates,  and  show  more  independence 
than  do  children  in  either  University  of  Kansas  or  University  cf  Oregon, 
which  are  classified  as  structured  models. 
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The  Intellectual  Achievement  Responsibility  Success  Scale  shows  a 
positive  correlation  with  variables  describing  the  more  open  classrooms. 
Our  results  indicate  that  children  from  the  more  flexible  classrooms  take 
responsibility  for  their  own  success,  but  not  for  their  failure.  Chil- 
dren in  classrooms  using  the  more  flexible  models  of  University  of  Arizona 
and  EDC  had  higher  adjusted  scores  than  children  in  classrooms  of  other 
sponsors.     Children  from  the  more  highly  structured  classrooms  take  re- 
sponsibility for  their  own  failure,  but  attribute  their  success  to  their 
teacher's  competence  or  other  forces  outside  themselves.    University  of 
Kansas  and  University  of  Oregon  sponsored  the  more  structured  models* 
and  children  in  classrooms  using  those  models  have  higher  adjusted  scores 
than  children  in  other  sponsors.     EDC  was  the  only  sponsor  to  have  positive 
residual  gain  scores  on  both  scales. 


E,      Outcomes  of  Regression  Analysis 

Stepwise  regressions  were  computed  to  assess  the  amount  of  variabil- 
ity for  each  outcome  measurement  that  is  explained  by  the  independent 
variables . 

The  WRAT  was  employed  as  a  measure  of  entering  ability  and  in  each 
cabB  the  regression  equation  was  constructed  by  entering  the  WRAT  scores 
first  and  then  determining  the  amount  of  variance  accountad  for  by  process 
variables  beyond  that  accounted  for  by  the  WRATv    The  proportion  of  the 
variability  among  class  averages  of  the  child  behavior  variables;  i,e,, 
independence,  task  persistence,  and  absence  rate  that  is  explained  by 
baseline  WRAT  score  is  essentially  zero  while  the  process  variables  ex- 
plained from  28%  to  67%  of  the  variability  for  these  measures.    Thp  WRAT 
explains  from  17%  to  50%  of  the  variability  of  the  MAT  first  and  third 
grade  math  and  reading  scores.     In  our  study  the  WRAT  is  more  predictive 
c  reading  scores  than  of  math  scores.     Interestingly,  a  set  of  ten  pro- 
cess variables  in  the  first  grade  and  eight  in  the  third  g   .de  offer  better 
prediction  of  the  math  scores  than  does  the  WRAT,    Process  variables  also 
account  for  a  considerable  amount  of  the  variance  in  reading  (23%  in 
first  grade  and  37%  in  third  grade).     For  the  Raven's,  approximately  the 
same  amount  of  variability  is  accounted  for  by  the  WRAT  (,41)  as  by  the 
process  variables  (,45),    Very  little  of  the  lAR  success  and  failure 
scale  is  predicted  by  the  WRAT;  however,  four  process  variables  accounted 
for  39%  of  the  variability  on  the  Success  scale  and  11  process  variables 
accounted  for  79%  of  the  variability  on  the  Failure  scale.  Collectively, 
these  results  provide  compelling  evidence  that  what  occurs  in  classrooms 
does  affect  child  outcome. 

An  attempt  was  made  to  replicate  a  regression  model  designed  by 
William  Cooley  and  based  upon  the  educational  theory  of  the  University 
of  Pittsburgh's  IPPI,    This  analysis  was  carried  out  by  John  Emrick  of 
SRI  on  the  1972  data.    The  first  study  was  based  upon  30  first  grades 
representing  five  sponsors  in  five  southern  sites,  while  the  second 
study  had  112  first  grade  classes  representing  seven  sponsors  in  25  sites 
in  many  geographical  locations. 
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In  spite  of  the  fact  that  a  different  baseline  test  battery  was  used 
in  the  two  studies  and  in  spite  of  the  difference  in  time  between  pretest 
and  posttests,  the  variance  accounted  for  by  entering  ability  was  similar 
for  both  studies.    However,  the  instructional  process  accounted  for  2.6 
times  as  much  of  the  variance  in  outcome  measures  in  the  1972  study  as 
in  the  1973  study.    Shared  or  joint  variance  of  entering  ability  and  in- 
structional processes  was  a  negative  10%  for  the  1972  study  and  a  posi- 
tive 1%  of  the  variance  in  the  1973  study.    The  instructional  process 
variable  "opportunity"  uniquely  accounted  for  17%  of  the  criterion  vari- 
ance in  the  1972  study  and  for  none  of  the  variance  in  the  1973  study. 
The  findings  of  the  large  percent  of  variance  accounted  for  by  the  pro- 
cess variables  specified  by  Cooley  for  the  first  study  are  not  replicated 
in  the  second  study.  However,  the  methodology  is  useful  and  a  set  of 
variables  selected  on  the  basis  of  the  findings  from  the  stepwise  regres- 
sion might  predict  more  of  the  outcome  scores. 


F.  Summary 

Two  issues  of  educational  importance  have  been  addressed  in  this 
report:     (1)  Have  a  variety  of  innovational  educational  programs  (Planned 
Variation)  been  implemented  in  diverse  sites  across  the  country?     (2)  If 
these  educational  models  have  been  installed,  how  have  they  affected  the 
growth  and  development  of  children? 

The  sections  on  sponsor  implementation  provide  convincing  evidence 
that  the  great  majority  of  teachers  in  the  first  and  third  grade  samples 
in  approximately  five  different  sites  per  sponsor  are  conforming  to  spon-- 
sor  specifications.     In  addition,  the  sponsors  have  been  distinguished 
from  each  other  in  important  classroom  practices.    The  Non- Follow  Through 
pooled  sample  proved  to  be  an  equally  good  comparison  for  all  sponsors. 
The  average  implementation  score  for  Non-Follow  Through,  regardless  of 
the  set  of  critical  sponsor  variables  used,  varied  only  from  59  to  63. 
The  implementation  score  of  each  sponsor  differed  statistically  from  Non- 
Follow  Through. 

The  effect  of  classroom  processes  upon  children  was  examined  through 
partial  correlations  and  stepwise  regressions.     Since  the  classroom  pro- 
cesses predicted  the  outcome  scores  as  well  as  cr  better  than  did  the 
entering  baseline  test  scores,  we  conclude  that  what  teachers  do  does 
make  a  difference.     In  the  more  academically  oriented  classrooms  which 
use  a  hif^h  rate  -f  drill,  practice,  and  praise  and  have  the  children  more 
frequently  engaged  in  reading  or  math  activities,  the  residual  gain  scores 
on  reading  and  math  are  higher.    These  children  also  take  more  responsi- 
bility for  their  failure  as  tested  on  the  Intellectual  Achievement  Respon- 
sibility Scale.     These  findings  are  supported  by  the  fact  that  the  spon- 
sors that  use  these  processes  in  their  classrooms  (University  of  Oregon 
and  University  of  Kansas)  also  have  higher  scores  on  these  tests.* 


With  one  exception,  EDC,  which  is  described  as  a  more  open  model,  had 
a  positive  adjusted  score  in  first  grade  math  and  the  third  grade  lAR 
Failure  scale. 
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The  more  open  interdisciplinary  classrooms,  which  have  a  wide  variety 
of  activities  occurring,  provide  a  wide  variety  of  materials,  allow  chil- 
dren to  select  their  own  groups  part  of  the  time,  and  allow  children  to 
engage  in  activities  without  adults,  also  have  higher  scores  on  the  Raven's 
perceptual  problem  solving  test;  students  are  absent  less  often  and  take 
more  responsibility  for  their  success  as  measured  on  the  Intellectual 
Achievement  Responsibility  Scale.    The  highest  scores  obtained  on  these 
tests  were  achieved  by  sponsors  who  specified  these  process  variables  as 
important  to  their  programs. 

The  educational  practices  employed  here  seem  to  be  resulting  in  pre- 
dictable and  desired  outcomes  for  the  children.    On  the  basis  of  our 
findings,  we  conclude  that  the  Follow  Through  program  of  planned  varia- 
tion is  being  implemented,  and  that  the  seven  sponsored  models  considered 
in  this  report  are  each  working  to  the  advantage  of  children — not  by  chance 
but  by  careful  design. 
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Appendix  B 

THE  EFFECT  OF  CHILDREN  CHARACTERISTICS  ON  CONTROL  SYSTEMS 
AND  ON  THE  DISPLAY  OF  EMOTION?  BY  ADULTS 


•r^  i-ry 


2.      Results  for  Pooled  Follow  Through  and  Pooled  Non-Follcw  Through 


a.      Percent  o£  Males  in  the  Classroons — Correlations 

The  results  presented  in  Table  B-1  indicate  that  a  preponder- 
ance of  boys  in  a  classroom  has  little  effect  upon  the  adult's  class- 
room control  or  display  of  happiness  or  anger.    Only  one  correlation 
out  of  26  is  significant  (p  <  0,5)  for  the  pooled  Follow  Through  class- 
rooms (at  this  level,  the  correlation  coulO  have  occurred  by  chance). 
Two  of  the  26  correlations  reached  significance  in  the  Non-Follow  Through 
classrooms.    The  first  correlation  indicates  that  in  classrooms  where 
there  are  more  boys,  the  adults  show  less  positive  affect;  in  fact,  they 
display  less  evidence  of  any  type  of  emotion  (Variables  423a,  430a)  that 
can  be  recorded  on  the  SRI  observation  instrument. 


b.  Percent  of  Children  with  Preschool  Experience— Correlations 

In  this  analysis,  the  classroom  average  in  months  of  preschool 
experience  was  correlated  with  each  of  the  adult  process  variables.  Re- 
sults are  displayed  in  Table  B-1.     Whether  or  not  a  child  has  preschool 
experience  does  not  appear  to  iniluence  the  way  in  which  Follow  Through 
teachers  treat  the  child.     In  Non-Follow  Through  classrooms,  however, 
the  teachers  were  more  likely  to  give  corrective-  feedback  to  children 
when  there  was  a  higher  percentage  of  children  with  preschool  experience 
(Variable  405a)  and  the  feedback  was  likely  to  be  for  behavior  (Variable 
448a).     In  addition,  Non-Follow  Through  teachers  with  a  higher  percentage 
of  children  with  preschool  experience  were  less  likely  to  demonstrate 
either  positive  or  negative  feelings  (Variables  423a,  430a). 

c .  Mean  Scores  on  Baseline  Wide  Range  A'^hievement  Test 
(WRAT)— Correlations 

In  this  analysis,  the  classroom  average  on  the  entering  level 
WRAT  was  correlated  with  each  of  the  adult  process  variables  also.  Re- 
sults are  displayed  in  Table  B-1.     Follow  Through  children  in  classrooms 
with  higher  average  entering  test  scores  receive  more  positive  corrective 
feedback  for  behavior  and  more  emotional  response  from  teachers  (Vari- 
ables 408a,  430a).     They  receive  less  positive  corrective  feedback  and 
neutral  corrective  feedback  for  tasks  (Variables  410a,  447a).     In  con- 
trast to  what  one  might  expect ^  no  significant  correlations  were  found 
between  academic  feedback  and  WRAT  scores. 

Children  in  Non-Follow  Through  classrooms  having  higher  enter- 
ing tes**  scores  received  tokens  less  oftr-.  than  children  who  had  lower 
entry  test  scores  (Variables  399a,  401a).    This  result  is  undoubtedly  a 
supious  finding  since  tokens  are  rarely  used  in  Mon-Follow  Through 
classrooms.    As  in  Follow  Through  classrooms,  children  having  higher 
entering  test  scores  receive  positive  corrective  feedback  less  often 
(Variable  410a).     Evidently,  teachers  in  general  give  those  chi:dren 
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who  enter  school  with  more  academic  skills  (as  measured  by  the  WRAT) 
less  positive  corrective  feedback  than  they  give  children  entering 
school  with  fewer  academic  skills* 


d.      Geographical  Regions — Analysis  of  Variance 

Regional  effects  were  assessed  by  comparing  classrooms  located 
in  the  North  Eastern,  North  Central,  Southern,  and  Western  United  States 
on  each  process  variable  in  an  analysis  of  the  variance.    The  results 
shown  in  Table  B-2  indicate  that  in  Non~Follow  Through  classroors  there 
is  no  relationship  between  geographical  region,  community  size,  or 
ethnicity,  and  classioom  control  or  affect  variables.    However,  some 
significant  relationships  were  found  in  Follow  Through  classrooms,  and 
the  direction  of  the  significant  relationships  is  shown  in  Table  B-3. 
(Note  that  *'High"  means  the  process  occurred  more  frequently  and  *'Low" 
means  that  it  occurred  less  frequently. ) 

Based  on  our  findings  (as  shown  on  Table  B-3) ,  it  appears  that 
Follow  Through  children  in  the  North  Eastern  region  are  less  likely  to 
receive  acknowledgment  for  behavior  or  academic  achievement  (Variables 
395a,  396a)  than  children  in  the  Southern  region.    However,  they  receive 
more  corrective  feedback  for  behavior  and  task-related  subjects  (Vari- 
ables 408a,  447a,  448a)  than  children  in  other  regions  of  the  country. 
More  praise  and  reinforcement  for  academic  achievement  (Variables  398a, 
399a,  402a)  is  given  to  children  in  the  North  Central  region  than  chil- 
dren elsewhere,  but  they  receive  less  acknowledgment  and  neutral  correc- 
tive feedback  for  behavior  (Variables  396a,  448a).    As  we  indicated 
earlier,  children  in  the  Southern  region  receive  more  acknowledgment 
for  behavior  and  academic  achievement  (Varia^''GS  395a,  396a).     They  also 
receive  more  positive  corrective  feedback  f. :  academic  achievement  (Vari- 
able  406a)  than  do  chrldren  in  other  regiond  of  the  country..  Praise 
and  reinforcement  are  used  less  often  for  achievement  in  academic  sub- 
jects (Variables  399a,  402a)  in  Western  classrooms,  but  adults  acknowl- 
edge acceptable  behavior  and  offer  praise  for  tasks  (other  than  academic 
tasks)  more  often  here  than  in  other  regions  (Variables  396a,  404a).  No 
clear  pattern  emerges,  and  the  regional  differences  noted  may  be  due  to 
the  different  emphasis  of  the  various  educational  models  reoresented  in 
these  regions. 


e.      Coimnunity  Size — Analysis  of  Variance 

The  effects  of  community  size  were  measured  by  comparing 
classrooms  in  communities  with  populations  of  over  200,000  (big  cities), 
between  50,000  and  200,000  (medium  cities),  between  iO,OuO  and  50,000 
(small  cities),  and  less  than  10,000  (towns  and  rural).    Table  B-2  pre- 
sents the  significant  results  over  all  communities  for  Follow  Through 
and  Non-Follow  Through.     The  direction  of  significant  results  for  Follow 
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Table  B-3 

THE  DIRKCTION  OK  SIGNIFICANT  RELATIONSHIPS  IN  THK  ANALYSIS  OF  VARIANCE 
FOR  FIRST  OKADl  ^  OLLOW  THROUGH  CLASSROOMS  (N=13()) 

GeoRr<  Phical  ReRions 
Var.  North  No'th- 


No. 

Variable  Name 

east 

central 

South 

West 

349a 

All  adult  acknowledgment  to  children 

Low 

High 

395a 

All  adult  acknowledgment  to  children,  academic 

Lev 

High 

High 

396a 

All  adult  acknowledgment  to  children,  behavior 

Low 

High 

398a 

All  adult  praise  to  children 

High 

Low 

399a 

Adult  reinforcement  and  token,  academic 

High 

Low 

402a 

Adult  praise,  academic 

High 

Low 

404a 

Adult  praise,  other  task  related 

Low 

High 

406a 

Adult  positive  corrective  feedback,  academic 

Low 

High 

408a 

Adult  positive  corrective  feedback,  behavior 

High 

Low 

4^7a 

Adult  neutral  corrective  feedback,  cask  related 

High 

Low 

Low 

448a 

Adult  neutral  corrective  feedback,  behavior 

High 

I  cw 

Community  Size 


399a 
423a 
430a 
4/;  7a 


Variable  Nam«^ 


Adult  reinforcement  and  token,  academic 
Fositiv^r  behavior,  adults  to  children 
Total  adult  affect 

Adult  neutral  corL*^ctive  feedback,  task  related 


Big 

High 
Low 
Low 
Low 


Small 
City 

Low 


Big 

lOWll 

Low 


Town 
and 
Rural 

Low 
High 
High 
High 


Var. 
No. 

397a 
398a 
399a 
402a 
405a 
430a 
449a 


Variable  Name 


All  adu}t  acknowledgment  to  children*  other  task  related 

Ail  adult  praise  to  children 

Adult  reinforcement  and  token,  academic 

Adulc  praise,  academic 

A^l  adoit  corrective  feedback  to  children 
Total  aO'ilL  affect 

Adult  iieatral  correcti/e  feedback  ♦  academic 


GlassrooKi  tilthnicity 
Wb  i  t  e      M  ixed  Black 


High 
Low 
Low 
Low 

Low  High 

High 

Low 


Low 
High 
High 
High 

Low 
High 


=  White  classrooms  are  those  with  <20%  black  children:  illxcd  classroorrs  have  20%  to  80% 
black  children;  and  Black  classrooms  are  thf>se  with  <SOt  black  children. 
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Through  by  community  size  is  shown  in  Table  B-3.     Follow  Through  chil- 
dren in  large  cities  receive  more  tokens  for  academic  achievement,* 
but  children  in  towns  and  rural  areas  receive  more  neutral  corrective 
feedback  that  is  related  to  tasks  (see  Variables  399a  and  447a  in  Table 

Children  in  towns  and  rural  classroom  environments  experience 
more  adult  expression  of  feeling,  especially  positive  affect  by  laugh- 
ing and  smiling  more  often  in  the  classrooms  (Variables  ^23a,  430a). 

f .      Ethnicity — Analysis  of  Variance 

In  this  analysis,  the  effects  of  three  groups  of  this  variable 
were  compared  in  an  analysis  of  variance.     (See  Table  B-2  for  the  over- 
all significant  relationships  for  Follow  Through  and  Non-Follow  Through.) 
Table  B-3  presents  the  "treatment"  groups  that  were  compared  in  Follo^/ 
Through.     These  groups  were  classrooms  with  less  than  20%  black  children, 
classrooms  with  20-80%  black  children  and  classrooms  with  more  than  80% 
black  children.     The  classrooms  were  labeled  as  predominantly  white, 
mixed,  and  predominantly  black. 

AdultJ  in  Follow  Through  classrooms  with  more  than  80%  black 
children  offer  more  praise,  reinforcement,  and  neutral  corrective  feed- 
bark  for  academic  achievement  than  do  adults  in  classrooms  with  differ- 
ent racial  compositions  (Variables  399a,  402a,  449a).     Children  in  class- 
rooms with  less  than  20%  black  children  are  more  frequently  acknowledged 
for  tasks  other  than  academic  ones  and  the  adults  show  more  positive  and 
negative  feelings  (Variables  397a,  430a).    When  the  racial  mix  of  a  class- 
room is  more  even,  the  children  receive  more  corrective  feedback  (Vari- 
able 4n5a). 


3.      Results  Within  Sponsored  Programs 

In  the  analysis  cf  individual  sponsors  entering  demographic  char- 
acteristics it  is  apparent  that  demographic  characteristics  and  site 
effects  are  confounded.     In  the  cases  of  regionality  and  community  pop- 
ulation, this  confounding  is  so  gross  that,  for  example,  often  within 
a  given  sponsor  one  site  will  be  isolated  in  each  analysis  as  the  sole 
representative  of  both  southern  region  and  rural  population.     Such  cases 
render  interpretation  Impossible,  and  the  effects  of  region  and  com- 
munity size  are  omittt  !  from  the  following  presentation^    Percent  of 
preschool  experience  is  also  omitted,  sl^ce  the  previous  analysis  in- 
dicated no  big  difference. 


*The  University  of  Kansas »  which  uses  tokens  in  its  model,  has  one  site 
in  a  small  town  and  four  large-city  sites  in  this  evaluation  sample. 

B-9 


ERLC 


a.      Sex  Differences — Correlations 


In  this  analysis,  a  relatively  continuous  child  character- 
istic (percent  of  male  children  in  classroom)  was  correlated  with  each 
of  the  adult  process  variables.    The  results  are  displayed  in  Table  B-4, 

Differences  in  this  analysis  are  extremely  slight.     At  the 
.05  alpha  level,  four  sponsors  had  no  significant  correlations.  In 
the  Far  West  model,  less  positive  and  neutral  feedback  occurred  ?.n  class- 
rooms where  there  were  more  boys  enrolled  than  girls.     However,  although 
only  these  two  variables  (Variables  410a  and  447a)  reach  a  significant 
level,  it  is  interesting  to  note  the  negative  direction  of  the  relation 
ship.     In  general,  it  appears  that  less  affect,  feedback,  and  control 
are  occurring  in  the  classrooms  where  there  are  more  boys  than  girls. 
This  observation  contrasts  distinctly  with  that  of  the  Bank  Street  model, 
where  the  sole  variable  (Variable  403a)  correlated  at  significant  levels 
indicated  chat  classrooms  with  more  boys  showed  more  occurrences  of  praise 
from  adults.     The  only  other  significant  relationship  occurs  in  High/Scope 
where  classrooms  in  which  more  boys  than  girls  were  enrolled  showed  more 
occurrences  of  punishment  (Variable  432a).     Here  a  strong  caution  must 
bo  made  reg-irding  correlational  data;  punishment  was  observed  rarely 
th*-oughout  the  Follow  Through  program,   including  the  High.  Scope  classrooms 


b.      Mean  WRt\T  Score — Correlations 

In  this  analysis,  tl;e  classroom  average  on  the  entering  WRAT 
test  was  correlated  with  each  of  the  adult  process  variables.  The 
results  are  displayed  in  Table  B-5. 

As  with  the  other  entering  characteristics,  relatively  few 
significant  results  were  obtained.     No  control  or  affect  variables  in 
the  Bank  Street  and  University  of  Oregon  classrooms  were  found  to  be 
related  to  baseline  WRAi  scores.     In  the  Far  West  model,  only  one 
correla*-ion  reached  a  significant  level.     It  indicated  that  children 
with  higher  WRAT  scores  received  more  neutral  corrective  feedback  for 
academic  achievement  (Variable  449a) . 

In  the  Arizona  model,  high  WRAT  scores  correlated  negatively 

with  neutral  corrective  feedback  for  behavior.     Thus  if  children  enter 

with  higher  test  scores  they  receive  less  neutral  feedback  (see  Table 
B-5,  Variable  448a). 

In  the  Kansas  model  children  who  entered  with  high  WRAT 
scores  received  more  acknowledgment  and  tokens  for  other  task- *-elated 
activities  (Variables  3'97a,  401a).     They  also  received  mere  neutral 
and  positive  corrective  feedback  for  behavior  (Variables  40£a,  448a). 
However,  children  with  the  higher  entering  scores  also  received  less 
positive  corrective  feedback  for  'jther  task-related  activities  (vari- 
able 410a).     Perhaps  more  was  expected  from  children  who  entered  with 
higher  test  scores,  because  there  is  no  evidence  that  they  received  more 
praise  or  tok*^ns  for  academic  achievement. 
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Chi[dr«.'n  in  Lhu  Ili^^h/Scopo  classrooms  where  higher  WI^l  scores 
had  been  found  tended  to  receive  less  neutral  and  positive  corrective 
teedback  for  tasks  than  children  in  other  classrooms  (Variables  410a, 
447a).     More  feelings  are  shown  in  classrooms  where  the  entry  scores  are 
hii;her,  and  teachers  show  mort.'  [)ositLve  affect  toward  children  (Variables 
423a,  430a). 

Children  in  EDC  classrooms  where  higher  WI<AT  scores  were  found 
tended  to  receive  more  positive  corrective  feedback  for  nonacademic  tasks 
and  less  positive  corrective  feedback  for  behavior  (Variables  408a,  410a). 
Adults  expressed  more  uniiappiness  (Variable  426a)  in  i:DC  classrooms  whi.'re 
the  entering  test  scores  were  higher. 

c  .       Children'  s  llthnicity — Analysis  of  Variance 

As  described  in  the  analysis  of  pooled  Follow  Through  and 
pooled  iNon-Follow  Through,  the  ethnicity  variable  was  divided  into  three 
groups  of  classrooms  and  its  effects  were  compared  in  an  analysis  of 
variance.     The  classrooms  were  labeled  as  predominantly  white,  mixed, 
and  predominantly  black.     Table  B-6  lists  those  process  variables  signif- 
icantly afff^cted  (p<.05)  within  each  sponsor,  and  shows  the  nature  of 
the  difference  among  the  thret   groupings.     The  direction  of  the  signif- 
icant relationships  is  Indicated  by  "High"  (positive  relationship),  "Med", 
and  "Low"  (negative  relationship). 

In  this  analysis,  three  sponsors  (Far  West,  University  of 
Arizona^  and  EDC)  showed  significant  ethnicity  effects  on  only  one  or 
two  process  variables.     Since  19  process  variables  are  examined  here, 
this  result  is  approximately  what  would  be  expected  by  chance,  and  it 
can  be  inferred  that  classroom  control  and  adult  affect  are  not  influ- 
enced by  children's  ethnicity  in  these  programs.     However,   in  the  case 
of  Far  West  the  data  indicate  that  children  in  classrooms  with  a  higher 
percentage  of  white  students  receive  more  acknowledgment  from  adults 
(Variable  394a), 

Among  the  other  programs.  Bank  Street  and  High/Scope  showed  an 
effect  or.  only  four  variables  each.     The  pattern  in  each  case  is  mixed, 
but  in  general  Bank  Street  provided  mo^  ^.  acknowledgment  and  feedback 
(Variables  394a,   395a,  406a)  in  classi  oms  classified  as  mixed  or  pre- 
dominantly black  tlian  in  classrooms  classified  as  predominantly  white. 
In  Hi^h/Scope  classrooms,  adults  more  often  expressed  unhappiness  (Vari- 
able 426a)  in  predominantly  white  classrooms,  and  neutral  corrective 
feedback  for  academic  activities  (Variable  449a)  was  more  ofuen  observed 
in  classrooms  classified  as  mixed. 

Most  of  the  differences  in  this  analysis  occurred  within  the 
two  more  structured  "reinforcement"  models.  University  of  Kansas  and 
University  of  .Oregon.     Unfortunately,  since  neither  sponsor  had  class- 
rooms classified  as  predominantly  white,  the  emergent  pattern  is  incom- 
plete, but  it  appears  that  adults  in  University  of  Oregon  classrooms 
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display  less  affuct  and  within  both  models  adults  use  less  corrective 
feedback  of  any  kind  in  classrooms  classified  as  predominantly  black. 
Caution  should  be  used  in  interpreting  this  set  of  data,  however.  An 
analysis  of  variance  will  show  significance  between  two  levels  that 
differ  only  very  sli^;htly  if  there  is  little  or  no  variance  within  one 
of  them.     That  is  the  case  here,  for  while  the  indicated  process  vari- 
ables were  at  low  levels  in  the  classrooms  classified  as  mixed,  they 
were  at  zero  levels  in  nearly  all  of  the  classrooms  classified  as  pre- 
dominantly black.     Because  there  is  no  variance  at  the  zero  Jevel,  the 
significance  of  the  slight  difference  is  exaggerated. 

In  this  analysis,  possibly  the  most  salient  (and  pleasant)  ob- 
servation is  that  within  the  seven  prograirs  only  two  instances  of  signif- 
icant differences  between  groups  were  found  for  variables  representing 
negative  or  unhappy  behavior  on  the  part  of  adults  (the  Variables  were 
407a,  A26a).     In  both  cases,  the  difference  may  be  statistically  exag- 
gerated by  appearing  between  low  frequency  of  occurrence  and  zero  occur- 
rence.    While  some  control  and  affect  differences  may  occur  within  spon- 
sors, as  far  as  we  can  tell,  no  ethnic  group  is  being  more  harshly  or 
negatively  treated  than  another  in  the  Follow  Through  program. 


D .  Summary 

In  all  of  these  analyses,  it  is  apparent  that  the  demographic  char- 
acteristics of  children  had  slight  effect  on  their  teachers'  behavior 
(and  we  might  infer  attitude)  toward  them.     This  observation  is  grati- 
fying from  two  aspects.     Althongh  the  demographic  characteristics  were 
neither  controlled  nor  randorrized,  the  sample  does  not  appear  to  inval- 
idate or  significantly  affect  the  analysis.    More  important  from  the 
standpoint  of  ala.  parties  interested  in  the  Follow  Throv'jh  program,  not 
the  least  of  whom  are  the  children,  if  bias  exists,  it  is  so  subtle  as 
to  be  unidentifiable  using  even  a  sophisticated  observation  procedure 
like  that  reported  here. 
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Classroom  Summary  Information 
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DIRECTIONS-  Make  sure  that  all  of  the  identifying  information  has  been  entered  on  the  Classroom  Summary 
Information  form  prior  to  your  observation  of  physical  environment.  Do  not  make  any  stray  marks  outside  the 
boxes  provided  in  places  where  written  information  is  required.  Make  sure  you  code  the  classroom  summary 
information  form  booklet  Identification  Number  in  the  I.  D.  grid  of  all  booklets  used  in  the  observation 
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OPKRATIONAL  DEFINITIONS  OF  THE  FIVE-MINUTE  OBSERVATION  CODES 


ERJC 


OPERATIONAL  DEFINITIONS  OF  THF  FIVF-MINUTE  OBSERVATION  CODES 


I •      Summary  of  Five-Minute  Observation 

The  Who  and  To  Whom  codes  are  used  to  indicate  the  participants 
in  an  interaction.     These  codes  make  it  possible  to  designate  the  per- 
son or  group  of  persons  initiating  or  receiving  an  action.     The  letter 
M  refers  to  such  items  as  typewriters,  tape  recorders,  films,  and  the 


The  12  What  codes  refer  to  the  action  categories  that  have  sur- 
vived several  years  of  use  and  review.     They  preserve  the  distinctions 
that  seem  to  be  important  in  describing  varying  classroom  processes. 

The  How  categories  are  used  in  conjunction  with  the  What  codes  to 
specify  emotional  or  descriptive  aspects  of  an  interaction  and  to  de- 
fine strategies  used  to  control  behavior. 

Operational  definitions  of  the  co.'es  used  in  the  classroom  obser- 
vation instrument  are  givan  in  the  following  subsections. 


Operational  Definitions 
a.      The  Who  Column 


like. 


action : 


The  Who  column  indicates  who  is  doing  the  talking  or  the 


Code 


Code  Usage 


T 


Teacher 


The  one  person  who  is  ultimately  responsible  for  the 
everyday  conduct  of  the  classroom. 


A 


Aide 


Classroom  adults  who  are  regular  in  their  attendance 
and  are  paid  by  Follow  Through  or  the  school  district 


V 


Volunteer 


Any  other  adult  who  works  in  the  classroom,  such  as 
a  parent. 


C 


Child 


When  the  focus  of  an  observation  is  on  a  specific 
child,  that  child  is  "C"  (all  other  children  ar-^ 
"D"  -  Different  Child).     When  the  focus  is  on  an 
adult,  C  refers  fo  any  individual  child  with  whom 
the  adult  is  interacting. 


D-3 


Code 


D  -  Different 
Child 

2  -  I^'o  Children 

S  -  Small  Group 

L  -  Large  Group 

/\n  -  Animal 

M  -  Machine 


A  second  child  in  an  interaction  when  the  focus 
child,  C,  is  being  observed. 


Three  to  8  children. 
More  than  8  children. 

Any  live  animal  in  the  classroom  (in'^luding  birds 
and  fish). 

Record  player,  tape  recorder,  TV,  and  so  on. 


b .      The  To  V/hom  Coxumn 

The  lo  Whom  column  indicates  the  person,  group,  or  machine 
that  is  being  talked  to  or  interacted  with: 


Code 


Code  Usage 


T 
A 
V 
C 
D 

S 
I. 
An 
M 


These  codes  are  all  che  same  as  the  codes  for 
the  l^o  column. 


c.      The  What  Column 

It  is  assumed  that  all  interactions  coded  in  the  What  column 
are  verbal  unless  marked  NV  (nonverbal).     (NOTE:     NV  and  certain  codes 
from  the  How  column  are  used  in  the  examples  below.     See  the  How  column 
definitions  on  p.  D-11.) 


Code 


I  -  Command  or 
Request 


Code  Usag*^ 


Code  1  asks  for  a  response  free  of  argument  or  spec- 
ulation. There  is  one  expected,  acceptable  response 
that  is  carried  out,  verbally  or  nonverbally: 


''Open  the  door,  please." 


TSl 


Code 


Code  Usage 


IQ  -  Direct 
Question 


Open-Ended 
Question 


-  "Read  this  sentence." 

-  "Draw  a  line." 

/-Lp  nw  up. 
"Gimme  tliat  book." 

IQ  questions  ask  for  direct  recall  of  material  al- 
read>   learned  or  anticipate  a  specific  or  automatic 
response  or  a  yes/no  answer.     IQ  questions  elicit  the 
following  responses;    statements  of  prefe*  ite- 
ments  of  fact,  itemizing;  classifying,  r  i 
tions . 


TCI  A 
TCI 
CTl 
CDl 


"In  the  story  did  you  like  Mr.  Brown?" 
";^mat  is  1/2  and  1/2?" 

"What  was  on  the  list  of  mountain  climbing 
equipment  we  made  yesterday?" 

"If  you  had  2  pears  and  3  apples,  what 
would  you  have  5  of?" 

"Is  this  dog  a  Great  Dane  or  a 
St.  Bernard?" 

"What  does  this  word  mean?" 


TCIQ 
CDIQA 

TLIQ 

TSIQ 

CDIQ 
TCIQ  A 


Code  2  questions  are  those  that  allow  a  free  expres- 
sion of  ideas  or  feelings  and  invite  opinions. 
Code  2  questions  encourage  responses  that  require; 
interpretation  of  ideas,  relationships  of  cause  and 
effect,  making  of  comparisons,  reasoning,  application 
of  previously  learned  material  to  a  new  situation,  and 
describing  a  process. 

Code  2  may  be  phrased  as  a  statement  as  well  as  a 
quest  ion . 


"WliaL  do  you  think  of  the  Eskimo  way  of 
life?" 

"l^my  did  you  like  Mr.  Brown  in  the  story?" 

"State  the  problem  in  your  own  words." 

"Tell  me  now  an  electric  train  works." 

"In  what  ways  are  the  things  in  this 
picture  alike?" 

"Use  these  sticks  to  see  if  you  can  find 
all  the  different  groupings  that  add  up 
to  10." 


TC2 
CD  2 
TC2 
CD2 

TC2 
TC2A 


ERIC 


D-5 


Code 


Code  Usage 


3  -  Response  Code  3  is  a  response  to  a  command  (Code  1),  a  ques- 

tion CC   .e  iQ,  2),  or  corrective  (Code  9). 

Wlien  the  response  is  concerned  with  basic  academic 
skills.  Code  3  is  used  with  A  in  the  How  column 
(see  definition  for  A  on  p.  14  );  Code  3  is  used  with 
B  in  the  How  column  when  it  follows  acknowledgment, 
praise,  or  a  corrective  tor  behavior  (see  definition 
for  B  on  p .  lA  ) . 


"Read  the  next  sentence,  Jimmy." 
"The  dog  chased  the  ball." 

"Will  you  add  2  and  2?" 
"2  and  2  makes  4." 

"Guess  what   I've  brought  for  you." 
"Flowers — or  an  apple." 

"Please  shut  the  door." 

The  child  shuts  the  door  (nonverbal). 

"Did  you  save  my  painting?" 
"Yes,  it*s  hanging  up." 

"We  can't  hear  when  you  do  that,  Alice." 
Alice  is  quiet.  t 


TCI  A 
CT3A 

TCIQA 
CT3A 

CT2 
CT3 

TCI 
CT3NV 

CTIQ 
TC3 

TC9GB 
CT3NVB 


A  -  Instruction,      Code  A  is  used  when  a  teacher  or  child  is: 
Explanation 

(1)  Verbally  giving  new  information  to  others,  re- 
viewing lessons,  or  explaining  rules  of  behavior. 

(2)  Nonverbally  engaged  in  demonstrating  or  in  an 
activity  that  is  productive,  organized,  or  ex- 
ploratory (including  game  playing,  blocks,  dolls, 
and  water  play) . 

•When  the  interaction  is  concerned  with  the  basic 
skills  of  reading,  writing,  spelling,  and  compu- 
tation. Code  A  is  used  with  A  in  the  How  column. 
If  an  object  is  being  used  in  self-instruction. 
Code  A  is  used  with  0  in  the  How  column. 

"Flowers  grow  everywhere.     There  ^re 

many  different  kinds  of  flowers  and 

they  grow  in  many  shapes  and  colors."  CLA 

-    "Here  i^  a  game  called  'Community 
People.*     You  play  by  matching  the 
pictures  on  your  card  with  those  on 
the  large  card."  ISA 


ER^ 


Code 


Code  I'sajo 


5  -  General 
Conunents/ 
General 
Action 


-  "This  is  how  I'd  like  you  to  do  these 
oxertisos:     First,   fold  vour  paper  in 
half  I  iko  this.     Then  in  half  agaMi 
like  this.     Then  put  the  firs^t  prob- 
lem Ln  this  square  and  the  second 

here."  ISA 

"I  made  my  puppet  out  of  an  old  sock 
and  I  made  his  eyes  from  pieces  of  a 
crayon  Cholding  puppet)."  CS4 

-  "Yuu  have  to  add  3  to  7  here  and 
carry  the  I  o\er  to  this  column; 

then  add  those."  CDAA 

-  Child  learning  the  shape  of  a  letter 
by  running  his  finger  over  a  sand- 
paper letter  on  a  card.     (NOTE:  When 
the  action  involves  only  one  person, 
the  Who  and  To  Whom  columns  are 

coded  with  the  same  letter.)  CCANVOA 

-  Child  readii.g  aloud  to  a  small  group 

of  children.  CSAA 

-  A  child  building  a  block  tower.  CCANVO 

-  Child  reading  to  himself.  CCANVA 

Greetings,  personal  compliments,  social  or  nontask 


Irrelevant  remarks  are 


related  comments  and  remarks, 
also  coded  5. 

-  "Hello."    "Good  morning."  TC5 

-  "That's  a  pretty  dress."  CT5 

-  "I  can't  stand  you  today."  CD5N 

Classroom  management  activities,  general  movement 
about  the  room,  mild  horseplay,  eating,  napping,  are 
coded  5NV.     (5NV  is  coded  only  if  there  is  no  talking 
along  with  the  general  action;  otherwise,  the  ob- 
server codes  the  kind  of  remark  that  is  accompanying 
the  general  action. ) 

-  Child  setting  the  table  for  lunch  or 
snack. 


Two  children  jostling  in  a  line. 
Teacher  walking  around  the  room. 


CC5NV 
22ANV 

TT5NVX 


'lask-Related  Code  6  is  used  for  a  statement  about  the  activity  or 
Command  problem  at  hand  Ln  which  children  and/or  aduJts  are 

involved . 


D-7 


Code  ^   _     Code  Usaje 


-  Two  children  making  clay  animals: 

C:  "This  clay  makes  my  hands  sticky."  CD6 
I):  "The  horn  won't  stay  on  my  cow."  DC6 
^:      "Mine  doesn't  havo  a  horn."  CD6 

Teacher  is  conducting  a  Show  and  Tell 
period : 

I:      "What  did  you  do  over  the  weekend?"  TLIQ 

C:      "i  wenc  to  the  zoo  with  my  daddy."  CT3 

D:      "The  tigers  are  really  big."  DT6 

C:      "The  elephants  are  bigger."  CD6 

-  Three  children  are  working  with  metal 
washers  and  a  balance: 

C:      "I  think  '3  big  washers  will  balance 

4  small  ones."  C26A 
D:      "IMI  try  it."  CD6A 
D:      "I  sure  like  your  cowboy  boots."  DC5 
C:      "11  balanced:"  C26A 


7  -  Acknowledge       An  Indication  that  a  response,  product  or  behavior  is 
recognized  or  agreed  with  is  coded  7.     Another  form 
of  acknowledgment  is  to  repeat  someone  else*s  state- 
ment immediately. 

Code  7  with  A  in  the  How  column  is  used  to  indicate 
acknowledgi?ent  of  a  response  having  to  do  with  academic 
subject  matter  (see  definition  of  Academic  on  p.  lA  )  ; 
Code  7  is  used  with  B  in  the  How  column  to  indicate 
acknowledgment  of  a  response  having  to  do  with  be- 
havior (see  definition  of  Behavior  on  p.  14). 

-    Nodding  (nonverbal)  to  indicate  the 


painting  is  acceptable.  TC7NV 

-  "Yes,  that's  the  right  way  to  knead 

clay,"  TC7 

-  "That  maLh  problem  is  correct."  TC7A 
"Thank  you  for  sitting  down  when  I 

asked  you."  TC7B 

-  "What  do  you  think  is  in  this  bag, 

Peter?"  TC2 

"1  think  it's  a  carrot."  CT3 

"You  think  it's  a  carrot."  TC7 


8  -  Praise  Code  ^  is  used  for  praise  of  a  response,  product  or 

behavior.     Praise  in  academic  areas  is  coded  8  with  A 
in  the  How  column  (see  definition  of  Academic  on 
p.  lA  )  ;  praise  for  behavior  is  coded  8  with  B  in  the 
How  column  (see  definition  for  Behavior  on  p.  lA  ). 


D-8 


ERiC 


Code 


9  -  Corrective 
Feedback 


10 


N'o  Response 


( ode  [  sage 

"What  a  prtUiy  pu-lure  vouWe  made!" 

"1  like  the  siorv  you  wrote  about  your 
trip,  J  im. " 

"You've  done  a  fine  job  on  your  math 
workbook. " 

"I*m  really  proud  of  you,  class,  for 
behaving  so  well  wliile  Mr.  Jones  was 
here." 


TC8 

TC8A 

TC8A 

TL8B 


Corrective  Feedback  is  the  attempt  to  change  or  modify 
a  response,  product »  or  behavior.     Code  9  is  used  when 
the  subject  of  the  observation  tries  to  change  an- 
other's behavior  or  corrects  his  answers  or  work. 

CoJes  G,  Q,  N,  and  P  from  the  How  column  can  be  coded 
with  9  to  show  the  method  used  to  effect  behavior  modi- 
fication (see  the  descriptions  of  codes  in  the  How 
column,  pp. 11 ,  12  ) . 

Code  9  is  used  with  A  in  the  How  column  to  indicate 
corrective  feedback  in  academic  areas  and  with  B  in  the 
How  column  to  indicate  corrective  feedback  having  to  do 
with  classroom  behavior. 

-  "Don't  throw  your  ball  against  the  wall; 

come  and  play  on  the  swing."  TC9GB 

"You'll  have  to  stay  in  at  recess  if  you 

continue  to  talk."  TC9NB 

"Are  you  sure  Sacramento  is  the  capital 

of  New  Mexico?"  TC9Q 

-  "The  answer  to  that  math  problem  is 

wrong."  TC9A 

-  "No,  that  word  is  spelled  b-u-i-l-d."  TC9GA 

"You  have  not  mixed  that  paint  cor- 
rectly. "  TC9 

Code  10  IS  used  for  nc   response  when  a  response  is 
called  fo*-  an  none  is  forthcoming  to  complete  the 
interaction.     (NV  is  not  coded  with  10,  because  10  is 
by  definition  nonverbal.) 


"Teacher,  may  I  be  next?" 

Teacher  does  not  reply  because  she  is 

talking  to  another  child. 

-    "Jimmy,   let  me  play  with  you." 
Jimmy  does  not  look  up  or  answer 


CTIQ 

TCIO 

CD  I 
DCIO 


D-9 


Codu 


H  -  Wailing  Code  11  is  used  to  code  Liu*  subject  of  the  observation 

Waiting  in  line  or  for  materials,  attention,  use  of 
equipment,  and  activity  change.     It  is  also  used  v;hen 
the  subject  is  not  attending  or  not  involved  with  any- 
one or  anything.     (NV  is  not  coded  with  li  because  it 
is  nonverbal  by  definition.) 


Child  waiting  at  the  teacher's  desk  while 
the  teacher  works  wi:h  another  child. 

Child  has  finished  his  work  and  is  sit- 
ting at  his  desk  staring  off  into  space. 


ecu 

CCll 


12  -  Observing,        Code  12  is  used  when  the  subject  of  the  observation 

Listening         is  listening  to  or  watching  other  people,  other  activ- 
ities, TV,  slides,  films,  and  the  like.     (NV  is  not 
coded  with  12.) 


A  child  sitting  on  his  chair  is  watching 
a  small  group  on  the  rug  play  with  blocks. 

Child  listens  to  another  child  give  a 
report . 

Teacher  stands  watching  the  children  and 
the  activities  in  the  room. 


CS12 
CD12 
'I  LI  2 


NV  -  Nonverbal 


When  the  action  being  coded  is  not  accompanied  by 
words,  NV  is  coded  in  the  What  column,  along  with  the 
other  relevant  codes. 


-  Child  laughing.  CCSNVH 

-  leacher  passes  out  material  silently  to 

a  sm^ill  group.  TS5NV 

-  Child  taps  the  teacher's  arm  without 

speaking,  requesting  her  attention.  CTINV'I 

Child  sits  down  in  response  to  a  request 

from  the  teacher.  CT3NV 

X  -  Movement  Code  X  is  used  when  the  subject  of  the  observation 

moves  and  for  movement  of  a  person  with  whom  the  sub- 
ject is  interacting.     X  can  be  used  with  any  What  cod 
if  the  movement  is  nonverbal  and  no  What  code  is  ap- 
plicable, code  X  with  5  (general  action). 

-  leacher  moves  about  the  room  while 

lecturing  to  the  class.  TL4X 

-  Child  asks,  "Miss  Smith,  will  you  help 

me?"  while  moving  to  the  teacher.  (J'lOX 


ERLC 


D-IO 


-  Child  walks  over  to  close  the  door  in 

rt'sponse  to  a  request  from  the  ttM^her.  (T  LWX 

-  Child  runs  to  the  door  when  recess  is 

announced.  CC'^^XVX 

d.       I he  How  Column 

Categories  in  the  How  column  are  used  in  ronjunction  with  the 
What  eodes , 


Code 


Code  Csage 


H  -  Happv 


U  -  Unhappy 


N  -  Ne>3;ative 


Ob'vious  behavioral  expressions  of  happiness  or  positive 
affect  (such  as  laughing,  smiling,  giggling,  when  they 
appear  to  indicate  pleasure  rather  than  fear), 

-  A  child  jumping  up  and  down,  clapping 

hands  and  grinning  over  a  new  puppet.  CCSN'VIi 

-  A  child  laughing  at  a  joke.  CC5NVH 

-  Teacher  smiles  as  she  says,  "What  are 

you  doing?"  TCIQH 

-  Child  smiles  in  reply  to  the  teacher's 

praise.  CT3NVH 

-  Two  girls  giggling  and  talking  in  the 

corner.  225H 

Obvious  behavioral  expressions  of  sadness  or  unhappi- 
ness,  such  as  crying  or  welling  tears. 

-  Child  with  tear-filled  eyes  waiting  in 
a  line. 


Child  crying. 


CCllNVU 
CC5NVl^ 


Expressions  of  annoyance  or  anger,  negative  content 
(e.g.,  sarcasm,  insults,  threats),  scolding,  rejection, 
destructive  behavior. 


-  "You're  stupid!" 

-  Teacher,  red-faced  and  tight-lipped 
with  anger,  glares  at  class. 

"Johnny,  if  you  can't  leave  Alice 
alone,   I  will  ask  you  to  sit  in  the 
corner. " 

-  Child  throws  jar  of  paint  on  the  floor 
in  anger. 


CD5N 
'I1.12\' 

TC9NB 
CC5NVN' 


D-1  I 


 Code 

T  -  Touch 


Question 


C  -  Guide/ 
Reason 


Punish 


  C o(.\e_  Vs age_  

UTienever  one  person  touches  another  person,  T  is 
coded — with  H  lo  denote  a  positive  touch,  with  N  to 
denote  a  negative  touch  (hit,  slap,  pinch),  and  with 
P  to  denote  a  punishing  touch  from  an  adult  to  a 
child. 


-  Girl  pinches  another  girl's  arm. 

-  Teacher  puts  her  arm  around  a  child  and 
smiles  as  she  says,  "Jenny,  will  you 
help  Margaret  with  ner  puzzle?" 

Teacher  moves  around  the  class  and 
touches  a  child  on  the  head  momentarily 
as  she  passes . 

-  Teacher  holds  child^s  hand. 
Teacher  spanks  child. 

Coded  with  1  for  a  direct  question  and  with  9  when 
corrective  feedback  is  in  question  form. 

-  "Are  you  sure  that  8  is  the  correct  answer?" 

-  "What  color  should  I  use?" 

-  "Didn't  I  tell  you  not  to  bother  Jimmy?" 

"You  weren't  paying  attention  when  I  ex- 
plained it,  were  you?" 


CD5N'VN'T 

TCIOHT 

TC5NVXT 

TC5NVT 

TC9NVPTB 


TC9QA 
CTIQ 
TC9QB 
TC9QB 


G  is  coded  with  9  when  corrective  feedback  is  positive 
and  guides  to  an  alternative  activity,  approach  to  a 
problem,  and  the  like,  or  when  the  corrective  includes 
a  reason  or  explanation. 

"It  might  work  better  if  you  turned  it 

around."  TC9G 

"Sit  down  so  the  others  can  see, 

Gerald."  -  TC9GB 

"If  you  knock  that  over  it  will  make 
Jim  angry,  so  please  build  your  own 

tower."  TC9GB 

Punish  covers  a  range  of  adult  disciplinary  or 
behavior-modifying  techniques,  including  withholding 
of  privileges,  isolation  of  a  child,  physical  punish- 
ment (coded  with  T).     P  is  coded  only  with  9, 

-  "Angola,  go  over  to  the  corner  and  sit 

there  alone  until  we*  re  throughl"  T(;9PB 

-  "Okay,  Fred,  no  recess  for  youl"  TC9PB 


D-12 


ERIC 


Code 


( ocit'  I  sage 


O  -  object 


W  -  Worth 


DP  -  DraiTiatic 
Play/ 
Pretend 


leather  spanks  thi Id  lor  disruptive 
benav  ior . 


Tc:9NVPr 


Concrete,  inanimate  objects  that  are  used  in  nonverbal 
sl'1  f-mstriiL  tion. 


-  Child  working  on  math  using  Cuisenaire 
rods . 

-  Child  building  a  blu^^k  tower. 

-  Child  fitting  together  pieces  of  a 


puzzl e . 

-  Small  group  using  pennies  in  working 
out  math  problems. 

-  Child  examining  several  kinds  of 
pine  cones. 

[NOTE:    When  an  object  (token,  candy,  and 
the  like)  is  given  as  a  reward  for  a  correct 
response  or  good  behavior,  0  is  coded  with  8.1 

Child  statements  of  self-worth,  self-praise,  or  self- 
esteem;  exclamations  of  accomplishment;  positive  re- 
marks about  one's  self;  bragging. 


CCANVOA 
CCAN'VO 

CC4NV0 

SSANVOA 

CCANVO 


-  "I  did  itT' 

-  "I  can  do  three  cartwheels  in  a  row!" 

-  "Isn't  my  dress  pretty?" 

Describes  play  acting,  puppet  showr,  and  other  dra- 
matic presentations,  talking  to  toys  or  dolls,  pre- 
tending or  making  believe,  role  playing. 

-  Boy  walking  on  all  fours,  howli^  ^  like 
a  wolf. 

-  Two  children  giving  a  puppet  show  to 
the  rest  of  the  class:     "Oh,  here  comes 
the  prince!" 

-  Child  talking  to  her  doll:     "Now,  Mary 
Pat,  you  know  Pve  told  vou  not  'to  do 
that." 

(MOTK:     Because  there  if,  no  cede  in  the  Who 
and  To  Whom  columns  to  symbolize  a  toy,  doll, 
or  other  object  of  that  kind,  the  example 
above  must  be  coded  as  if  the  child  is  talking 
to  ha:rself.) 


CT5W 
CD6W 
CTIQW 


CC5NVDP 


CL6DP 


CC9BDP 


D-13 


.  .J^ri!5--  ^'P.^^\     _ 

A  -  XiMdomi*.  TnLoractions  tb.nt  have  to  do  with  the  development  of  basic 

skills,  ai»  moasurt'd  un  dchievement  tests:     reading  (letter 
and  word  recognition,  vocabulary,  pronounciat ion,  grammar), 
wr  it  ing,  and  computat  ion  (number  recognit  ion,  count  ing,  add- 
ing, subtract  ing) , 


-     "What   is  2  plus  2?" 
"Two  and  2  is  5." 
"No,   it's  4." 

"You  read  beautifully  today,  Aaron." 

"Will  you  show  me  how  to  do  this  problem, 
Robert?" 

"I  figured  out  that  word  all  by  myself!" 


TCI  OA 

CT3A 

•IC9(.A 

T(:8A 


CDIQA 
CT6UA 


Behavior  Describes  interactions  concerned  with  classroom  behavior 

(deportment,  conduct),  B  is  used  only  with  the  feedback 
ct)(i''s  (7,  8,  9)  and  with  the  responses  thereto. 


The 


"S  J  t  down — now ! " 
Ch  i Id  sits  down . 

"You  were  very  quiet  in  group  time  today, 
Ralph,  and  we  all  ap^^reciated  it.     Good  for 
you!" 

Ralph  smiles. 

"Betty,  please  go  over  and  work  on  your 
collage  instead  of  bothering  Gina. 
Betty  replies,  "O.K." 

(NOTE:     If  neither  A  nor  B  is  coded,  it  is 
assumed  that  the  frame  concerns  other  task- 
related  content.) 


and  (c}Codt 


T(:9H 
CT3NV{5 


TC8B 
CT3NVHB 

TC9GB 
CT3B 


(Kj-  RHPKAT,   (S)-  SIMULTANEOUS,  and   (c)-  CANCEL  are  located  in  the  left 
margin  of  each  interaction  frame. 


0:>_de_   Code  Usage 


(R^-  Repeat  If  the  interaction  being  observed  continues  wichout  change 

or  interruption,  code(R)is  used  in  subsequent  frames  approxi- 
mately every  5  seconds  until  the  action  is  interrupted  by 
another  interact  ion ,  or  stops .   (R) repeats  the  interact  ion 
from  the  frame  above. 

-  Simulta-  The  simultaneous  code  is  used  to  record  inattention  by  a 

neous  child  or  children  while  an  adult-led  activity  is  going  on. 

It  allows  the  observer  to  record  what  the  child  or  childrcMi 
are  doing,  as  well  as  the  activity  to  which  they  should  he 
attend  ing. 


ERIC 


D-l/t 


In  ch  i  Id-f  lh  usod  ohht-rval  ions,  thf  s  imu  1  laneoiis  codv  is  used 
to  rtH  .>rd  rlu'  .htivitv  t!\al  tho  child  is  ignoring, 

A  <hlld  i*^  lihtoning  to  a  nacii  lesson: 
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He  continues  to  listen  for  10  seconds: 
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The  child  starts  to  pull  the  hair  of  the  girl 
sitting  next  to  her: 
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If  the  teacher  continues  with  the  math  lesson 
while  the  child  is  pulling  her  neighbor's  hair, 
the  teacher's  actions  are  coded  and  the (s) is 
recorded  with  it  to  show  the  activity  that  the 
child  is  ignoring. 
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Iv  tlie  case  of  act  ivity/adul  t-fooused  observations,  the 
S iinul  t<in*^<Mis  ccuk'  is  u^cd  to  show  inattention  on  tht*  part  of 
a  Sri<i  I  1  or  largt*  (J  roup.     ft   is  not  used  to  show  inattention 
on  the  p<!rt  of  unlv  one  or  two  children  within  the  larger 
group. 

The  teacher  is  giving  a  niath  lesson  to  a  Large 
Group  of  children: 
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She  continues  with  her  uninterrupted  lecture 
((jUis  Loded  everv  five  seconds  as  she  continues): 
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G 
G 

Who 

G®G 
GGG 

©©o© 

To  Whom 

©©© 
©©© 
©©©© 

What 

©©©©© 
©©©©© 

©©  G© 

How 

®®®® 
®o© 

©©©  ®® 
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9 

O 
O 

Who 

©©© 
©©© 
©©0© 

To  Whom 

©©© 
©©© 
©©©© 

What 

©©©©© 
©©®@® 

®®  G© 

How 

©©©0 
©©© 

©©©  ©® 

® 


® 


IChen  a  small  gruup  starts  giggling  while  the  teacher  con- 
tinues lecturing,  Cod*^(s)is  used  in  the  left  margin  of 
the  ne:<t  interaction  block;  then  the  new  interaction 
(small  group  giggling)  is  coded   in  the  same  block  to  show 
the  children's  inattention: 
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© 
© 

Who 

©®® 
®®® 
@®©® 

To  Whom 

®®® 
®©® 
@®®® 

What 

®®®®@ 
®®®®® 

0©  d© 

How 

®®®® 

@©© 

©©©  ®® 

©.SS5NV11 
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  .'^  _  _ 

It  the  dual  aotivitv        ''teacher  lectur  mg-chi  Idren 
giggling"  v'oiUinues  for  n^sore  than  five  secondi^,  (ode(R) 
IS  u-^oJ  in  the  interaction  block(s)  to  shov  the 

continuation  of  the  dual  activities: 
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d 

o 
o 

Who 
©®0 

OO© 

©©©© 

To  Whom 

©©© 
©©© 
©©©© 

What 

©©©©© 
©©©©© 
0©  00 

How 

©©©© 
©©© 

©©©  ®© 

If  a  different  interruption  occurs  (e.g.,  small  group 
of  children  arguing)  during  the  same  lecture,  the 
first  coding  (TLAA)  is  returned  to  before  the  new 
interruption  is  coded: 
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© 
© 
© 

Who 

•  ®® 

®®® 
®©©® 

To  Whom 

®®® 
©®® 
©•©® 

What 

©©©•© 

©©®®® 
0®  00 

How 

©©©© 
®®© 

©®©  \9® 
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® 

© 

Who 

®®® 
®©® 
©®®® 

To  Whom 

©®© 
©©© 
«®®0 

What 

©©©©• 

0©®®© 
O©  0© 

How 

©©© 

©©©  ©@ 

(S)SS5X 


(T)-  Cai.cel  When  a  mistake  is  made  in  coding  an  interaction,  Code  (c) is 

used  in  the  left  margin  of  the  miscoded  frame  and  the  next"* 
frame  is  coded  correctly. 

Teacher  is  lecturing  to  a  large  group.     Observer  mis- 
taken! v  codes  TL5.     Code(£)is  used  in  that  frame  to 
show  the  error  and  Code  TIA  is  marked  in  the  following 
frame : 
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© 
© 

9 

Who 

«©© 

©©© 
©©©© 

To  Whom 

®®® 

0®® 
®«®® 

What 

®®®®« 

®®®®® 
®®  00 

How 

®®®® 
®®® 

®®®  ®@ 
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© 
© 
© 

Who 

•  ®® 

©©© 
©©®® 

To  Whom 

®®® 
©®® 

©#0® 

What 

©©©•© 

®©®®® 

®®  00 

How 

®®®® 
©©© 

©00  ©@ 

D-17 


Observer  is  coding  an  irteraction.    She  forgets 
a  code,   is  momentarily  blank.     She  records  Code  (C) 
and  begins  again,  for  example: 
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© 
© 
• 

Who 

©®© 

©©© 
©©©© 

To  Whom 

©®© 
•  ©© 

®®©® 

Whdt 

©©©©© 
©•®®® 

®®  0® 

How 

©©©© 
©©© 

©©©  ®® 
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© 
© 
© 

Who 

e®© 

©®@ 
©©©® 

To  Whom 

©®® 
•  ©© 

©©0® 

What 

®®®®© 
©®@@© 

©•  |©(i) 

How 

®©®© 
@©© 

©©©  |©@ 

^ •      Hxamples  of  Coding  the  Five "Minute  Observation 

After  the  person  to  be  observed  has  been  identified  and  the  adult  parnic  ipa- 
tion,  the  activity,  and  the  time  started  have  been  recorded  in  the  Preamble,  the 
observer  should  begin  immediately  Lo  record  the  interactions  in  which  the  iocus 
person  is  taking  part.     These  interactions  are  recorded  in  the  frames  numbered 
1  through  76,  using  the  codes  as  defined  on  p.  D-3.     One  frame  is  used  for 
each  interaction  recorded.     For  example: 


Teacher:     "Please  sit  down,  class." 


1 

® 
© 
© 

Who 

•  ®© 

®@© 
®®®® 

To  Whom 

©®© 
©©© 
0^0® 

What 

•  ©©©© 
®©®®® 

®®  00 

How 

®©®® 
©0© 

©©©  ®® 

Class  sits  down  as  requested. 


2 

® 
® 
® 

Who 

®®® 
®®© 
©«©© 

To  Whom 

•®© 

®©© 
®®o® 

What 

®®«®® 
©®®@® 
©©  #© 

How 

©©©© 
©©© 

©©©  ®@ 

LT3NV 
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Teacher:     "Open  your  books  to  page  '*3." 


OO©  " 

Who 

•  ©© 

©©© 
©©©© 

To  Whom 

G®© 
©C® 
®«®® 

Wh  . 

•  ©®®G 

®®®®© 

®®  (0© 

How 

G©©© 
©©© 

OQO  (A)® 

Class  does  as  requested  (opens  books) . 
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© 
0 
® 

Who 

©©© 
©©© 
©•©© 

To  Whom 

•  ®© 

®®® 
®®®® 

Whjt 
®®©®® 

©O®®® 

®®  •© 

How 

®®©® 

®00 

®®®  (A)® 

Teacher:  "John,  will  you  please  read  that 
page  for  us?" 
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© 
© 
© 

Who 

e©© 

GO® 
©©©© 

To  Whom 

©®o 
*©© 

1©©©® 

Wh.it 

s®®®® 

®®®®® 
©®  00 

How 

©©©© 
•©© 

©©©  •© 

John  reads  as  requested. 
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© 
© 
© 

Who 

©©© 
•  ©© 

0©©® 

To  Whom 

•  ®© 

®®® 
®®0® 

Whdt 

®®«©® 

®®®®® 

®®  0® 

How 

®®®® 
®®® 

®®®  [5^ 

CT3A 


John  continues  to  read  to  the  class. 
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© 
© 
© 

Who 

0©© 
n©© 

©©©© 

To  Whom 

©®© 
®©© 
Q9e® 

What 

®®®®® 

®®®®® 
®®  |0S 

MOW 

®®®® 
@®© 

©©©  6® 

An  average  oi  5  seconds  is  expected  for  coding  each  interact- ^^n  frame.  Some 
observers  ray  go  somewhat  faster  or  slower,  but  an  effort  should  be  made  to  enter 
60  interactions  during  each  FMO.     The  observer  will  develop  his  own  pace. 

It  is  important  to  remember  to  coda  complete  interactions. 
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^ •      Time  Stopped 


At  the  end  of  exactly  5  minutes,  the  observer  must  s'op  coding  and  write  th 
time  in  the  box  marked  "Tine  Stopped"  on  the  hist  page  of  the  observation  slieet. 
For  example,   if  coding  is  stopped  <it  9:17,  the  Time  Stopped  box  would  be  filled 
in  like  this: 


TIME  STOPPED 

Hour 

Mmute 

©•© 

©©©©© 

o®®®® 

©0® 

©©#©© 

if  coding  is  stopped  at  10:10,  the  Time  Stopped  box  would  be  filled  in  like 

this: 


TIME  STOPPED 

Hour 

Minute 

©©•©@ 

©•© 

•  ©©©© 

O©©©® 

©©© 

©©©©© 

xMthough  it  is  important  that  the  observation  be  exactly  5  minutes,   it  is 
Pore  important  to  be  accurate  in  showing  the  actual  times  started  and  stopped. 


^ ■      Activity  Change 

The  Activity  Change  box  is  filled  in  at  the  end  of  ^.he  Fnu  form  only  if  the 
activity  recorded  in  the  Preamble  has  changed  during  the  course  of  the  FMO.  Num- 
bers in  the  Activity  Change  box  refer  to  the  numbers  in  the  CCL.     For  example: 

Activity  in  the  Preamble  -..'as  CCL  Item  6  (Arithmetic,  Numbers,  Math) 
shown  in  example  A  below.     During  the  'course  of  the  FMO  coding,  the 
teacner  changed  the  activity  of  the  group  to  CCL  Item  9  (Science, 
Natural  World).     The  observer  must  code  this  change  at  the  end  of 
the  observation,  as  shown  in  example  B  below. 


ActiV 
ity 


&(2) 
0® 
®® 
® 
® 
® 

® 
® 
® 


ACTIVITY  CHANGE 

1  /   i   .      r  7  o  :•  n  n 

oooooooo@oo 


\7  n  "  \  »5  1G  \7  \f)  '0  ?0  ?1  2? 

OO..GOOOOOOO 
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Appendix  K 

WEEKLY  ROSTER  LIST  AND  CLASSROOM  OBSERVER  DAILY  LOG 


APPTNDIX  V 


ICLIKIY  ROSIfK  I         AM)  CLASSROOM  OBSLKVi  R  DAllY  LOO 


^  '  I  y  Ho  s  t e  r  List 

All  classroom  observers  wore  reqaired  to  Hll  out  a  Weekly  Roster  List  thiC 
recoriieci  the  following  i  n  to  rmati  on: 

Dc? te — The  date  an  observation  was  conducted, 

Scnoo  I  ^^'P^^-^The  name  oi  the  s».bool   in  which  the  observation  was  conducted 
on  the  date  designated. 

leai he r  Name — The  name  of  the  teacher  whose  class  was  being  observed  on  that 
day . 

loacaer  Xunber— The  number    .ssigned  to  the  teacher  and  found  on  the  label  in 
the  left-hand  corner  on  the  top  front  page  of  each  observation  booklet, 

Cjrade  —  I he  grade  level  of  the  class  being  observed  which  appeared  on  the  label 
of  caih  booklet.     If  the  grade  level  of  the  class  differed  from  that  on  the 
label,  It  was  noted  on  the  booklets  and  on  the  Weekly  Roster  List, 

PX-vp-f-' Indicated  whether  the  class  being  observed  ^as  a  Follow  Through  (FI) 
or  a  Non-FoUow  Through  (N'F'I)  class.     This  designation  also  appeared  on  the 
label  m  the  upper  left-hand  corner  of  each  observation  booklet, 

Observat ion — Referred  to  whether  the  observation  day  was  ac t i vi  ty /aJ»;lt  fot  us 
or  individual  child  focus. 

Booklet  I  ,  D .  Jj^irnb  e_r — The  four-digit  nuirber  found  in  the  top  right-hand  corner 
of  oach  red  he.-der  booklet. 

Number  of  FMOs  Used — The  number  of  5 -minute  oh&^rvations  conducted  each  day. 

Re  1  lah i 1 ^ ty  Check  -  Date — The  date  the  reliability  check  was  done  and  the 
booklet  1,D.  number  'Sed. 

Comments — When  anything  unusual  occurred  during  an  observation  day,   the  ob^ 
server  was  instrui  t.ed  to  note  it  in  the  "Comments"  section  of  the  Weekly  Roster. 
These  comments,  along  with  entries  from  the  Classroom  Observer  Daily  Log, 
served  to  reveal  anomalies  that  might  invalidate  observation  or  justify  its 
omi  ss  i  on , 

.'number  of  Booklet^^  Returned  in  this  Box — This  (in  the  upper  right-hand  corner) 
was  filled  out  as  soon  as  all  observations  for  the  week  had  been  completed  and 
the  bo"  made  readv  fo»*  shipment  to  SRI, 
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^'      C    s s  r o o m  Qb^c  r v<.m'      iJx  i-^iil 

Observer^  wero  <^ih  ^iw^-i^  a  Classroom  Obscrvt^r  D<iilv  Log  in  which  to  record 
varKMi-^  KintN  vM    laMriiiiun  ptrtineiu   lo  Uu'i^  ub  st' rv  at  i  ons .     Ihe  log  was  divided 
into  two  main  parts  .oi^^i^tioj  o!   s^^Uon  i,  "DirtnCory,  uaily  Log,"  and  Section 
n»  "Rt^<)r»i  or  Materials  dud  A«  c  i  vi  t  ios  .  " 

lnstru<  lions  tor  V^tion   !  u  ♦  » .  .     "IMctise  consider  this  booklet  a  daily  journal. 
Carry  it  with  vou  at  all   ti-v.'s  so  t'lat  vou  can  have  nL-it'ssary  phone  numbers  av;iii- 
ahU'  and  (.an  make  a  complete,    i-nc  u  oi  toi<tact  with  school  and  Follow  Through  per- 
sonnel,"    (SRI  Stat  J   names  and  p^one  numbers  were  listed  in  the  Log  as  an  aid  to 
observers.)     In  this  section,  theretore,  the  observer  recorded  names  of  school 
personnel  worked  or  talked  wiib,   their  p;sitions,   their  school  affiliations,  and 
their  tt>lephone  numbers.     ihe  observer  ali,o  cataloged  meetings  attended  and  topics 
d  is cussed . 

Section  II  was  de^igneu  so  that  observers  could  record  for  each  observed 
classroom  all  texts  (with  rublisiier  name),  materials  used,  and  f;eid  trips  or 
other  activities  done  in  .onjunction  with  reading,  math,  social  studiLS,  and  science, 
lexts  and  so  on  used  in  other  subjects  (such  as  arts  and  crafts  or  music)  were  de- 
scribed in  a  category  called  "Other."    Obseiv-^is  also  cataloged  activities  ob- 
served (as  required  on  Ac t ivi  ty/^-^u  i  1  t  focus  days)   in  the  order  they  occurred  during 
the  clay,  desuuiatxu^  tne  particular  activity  by  code  as  defined  on  the  Classroom 
Check  list.     Some  observers  also  noted  the  teacher*s  entire  schedule  for  the  day, 
as  well  as  listing  the  activities  specifically  observed. 

The  last  part  ot  Section   II  was  designed  so  that  observers  could  answer  par- 
ticular questions  pertaining  to  why  certain  classes  had  not  been  observed  on  a 
Scheduled  day »  why  the  required  number  of  observations  had  not  been  coded,  or  why 
requested  activities  had  not  been  observed.     A  sample  page,  as  printed  in  the  Log, 
is  shown  below: 


If  the  assigned  c  1  iss  wa^  observed  today,  why  not? 

a.       field  trips 


b,  could  not  c^ontac  t  teacher 

c,  teacher  ill  

d,  I  was  ill 


inte  rrup  tic^ns — specify 


r.      other  (SRI  contacted) — specify 


It  the  assigned  number  of  FMOs  were  not  observrd  today,  tell  why. 

a ,  field  trips  _   

b.  teacher  ill  _ 
I  Was  i  11 


c , 


d.  in te r rupt i ons--spec i f y   

e.  other  (SRI  contacted) — specify 
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3.  It  thv  ahSigtU'J  number  oi   Child  Foeiis  FMOs  wt^re  not  observed  today, 
tell  whv. 

.1.       tit'ld  trips   _        _  _____ 

b.  tt'ather  ill  

C'  children  ill  ^ 

d.  stiort  day  ^  

e.  interruptions — specify 

f.  other  (SRI   Lontacted) — ^P«"'eify_  

4.  If  requested  activities  were  not  observed,   tell  why. 

a.  didn't  occur'  __ 

b.  Occurred  simultaneously  with  other  activities 
i  .  other 


Finally,  blank  pages  were  inserted  at   the  e.id  of  the  lo^  so  that  observers 
could  record  any  other  comments,  problems  or  suggestions  that  occurred  to  them. 

The  reader  must  keep  in  mind  that  these  reports  are,   for  the  most  part,  sub- 
jective.    Timts  noise  level,  and  rejections  by  a  teacher  would  be  experienced 
different  I V  bv  observers. 


Appendix  F 

CLASSROOM  OBSERVATION  VARIABLE  LIST  FOR  SPRING  1973 
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Appendix  F 

CLi\SSROOM  OBSERVATION  VARIABLE  LIST  FOR  SPRING  1973^v 
Classroom  Summary  I-if ormation  (CSI) 

Variable  No.  Description  


\  1  Sponsor 

2  Site 

3  Center 
^  Teacher 
5  Pupil  code 


6  Reliability/regular  observation 

7  Grade 

8  Observer  Code 

9  Date 

10  Number  of  children  enrolled 

11  Number  of  child»"en  present 

12  Number  of  teachers 

13  Number  of  aides 

1^  Number  of  volunteers  present 

15  Child/ teacher  and  aide  ratio  (Number  of  chilr^en  over  the 
number  of  teachers  and  aides) 

16  Child/Adult  Ratio  CNuraber  of  children  ove:-  the  number  of 
teachcr<?,  aides,  and  volunteers.) 

17  Total  class  duration 


Physical  Environment  Information (PEI) 


18  Movable  tables  and  cliairs  for  seating 

19  Stationary  desks  in  rows 

20  Assigned  seating  for  at  least  part  of  tlie  day 

21  Children  select  their  oim  seating  locations 
Teacher  assigns  children  to  groups 

23  Children  select  tlieir  own  work  groups 

24  Child  selection  of  seating  and  work  groups 

25  Games,  toys,  play  equipment  present 

26  Games,   toys,  play  equipment  used 

27  Instructional  materials  present 

28  Instructional  materials  used 

29  Montessori,  other  educafonal  toys  present 

30  Montessori,  other  educational  toys  used 


^'^See  Appendix  G  for  details  concerning  variable  specifications, 
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PEI  (continued) 


31  Children's  texts,  workbooks  pr^^sent 

32  Ciiildron's  texts,  workbooks  used 

33  \ath/Science  equipment,  concrete  objects  present 

34  Math/Science  equipment,  concrete  objects  used 

35  Instructional  charts  present 

36  Instructional  charts  used 

37  Audio  visual  equipment  present 

38  Audio  visual  equipment  used 

39  General  equipment,  materials  present 


General  equipment,  materials  u?ed 
Children's  own  products  on  display 
Displays  reflecting;  children's  ethnicity 
Photographs  of  the  children  present 
Total  number  different  resource  categories  rov' 
"present"  over  three  days 

Total  number  different  resource  categories  coded 
"used  today"  over  three  days 


46  Number  of  COP's,  adult  focus 

47  Number  of  COP's,  child  focus 
^8  Achievement  charts  present 
^9  Achievement  charts  used 

50  Cooking  and  sewing  supplies  present 

51  Cooking  and  sewing  supplies  used 

52  Carpentry  materials,  large  blocks  preser 

53  Carpentry  materials,  large  blocks  used 

54  Sandbox,  water  table  present 

55  Sandbox,  water  table  used 

56  Magazines  present 

57  Magazines  used 

58  Children's  story  books  present 

59  Children's  story  books  used 

60  Total  number  of  CCL's 


Classroom  Check  List  (CCD 

A.      Classroom  Activities:    Over  three  days,  how  is  the  children's  time 
diw  tributed?- 

Variable  No.  Distribution 


61  Lunch,  snack 

62  Group  time 

63  Story,  music,  dancing 

64  Arts,  crafts 

65  Guessing  games,  table  games,  puzzJes 


These  CCL  Variables  will  be  weighted  proportions.  See  page  F-11  for 
Weighting  Scheme. 
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CCL  (continued) 


66 

Numbers,  matli,  arithmetic 

67 

Reading,  alphabet,  language  development 

68 

Social  studies,  geography 

69 

Science,  natural  world 

70 

Sewing,  cooking,  pounding 

71 

Blocks,  trucks 

11 

Dramatic  play,  dress-up 

73 

Active  play 

74 

Practical  skills  acquisition 

75 

01. serving  (independent  children  only) 

76 

Social  iiiteraction 

11 

Unoccupied  chi Id 

78 

Discipline 

Transitional  activities 

80 

Classroom  management 

81 

Out  of  room 

82 

Wide  variety  of  activities,  concurrent 

83 

Wide  variety  of  activities,  over  one  day 

84 

Approximate  number  of  children  in  the  classroom  in  any 

activity 


Classroom  Groupings:  Overall  activities,  what  percent  of  the 
time-''^  is  an  adult  in  each  of  these  situations? 


Variable  No>  Description 


85  Teacher  without  children 

86  Teacher  with  one  child 

87  Teacher  with  two  children 

88  Teacher  with  small  group 

89  Teacher  with  large  group 

90  Overall  teacher  occurrences 

91  Aide  without  children 

92  Aide  with  one  child 

93  Aide  with  two  children 

94  Aide  with  small  group 

95  Aide  with  large  group 

96  Overall  aide  occurrences 

97  Volunteer  without  children 

98  Volunteer  with  one  child 

99  Volunteer  with  two  children 

100  Volunteer  with  small  group 

101  Volunteer  with  large  group 

102  Overall  volunteer  occurrences 

103  Adult  without  children 

104  Adult  with  one  child 

105  Adult  with  two  children 


''fSee  Weighting  Scheme  on  page  F~ll. 
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CCL  (continued) 


Adult  with  small  group 

Adult  with  large  group 

Overall  occurrcMices  of  adults 

One  child  with  any  adult 

Two  children  with  any  adult 

Small  group  of  children  with  any  adult 

Large  group  of  children  with  any  adult 

Overall  occurrence  of  children  with  any  adult 

One  child  independent 

Two  children  independent 

Small  group  of  children  independent 

Large  group  of  children  independent 

All  children  independent 

Number  of  children  in  the  classroom  times  the  number 
of  CCL's 


Math  Groupings:  l^ien  math  occurs,  which  percent  of  the  time* 
is  a  child  in  each  of  these  groupings? 


Variable  No. 

Description 

120 

One  child  with  teacher/Math 

121 

Two  children  with  teacher/Math 

122 

Small  group  with  teacher/Math 

123 

Large  group  with  teacher/Math 

124 

One  child  with  aide/Math 

125 

Two  children  with  aide/Math 

126 

Small  group  with  aide/Matli 

127 

Large  group  with  aide/Math 

128 

One  child  with  volunteer/Math 

129 

Two  children  with  volunteer/Math 

130 

Small  group  with  volunteer/Math 

131 

Large  group  with  volunteer/Math 

132 

One  child  with  any  adults/Math 

133 

Two  children  with  any  adults/Math 

134 

Small  group  with  any  adults/Math 

135 

Large  group  with  any  adults/Math 

136 

One  child  independent/Math 

137 

Two  children  independent/Math 

138 

Small  group  of  children  independent/Math 

139 

Large  group  of  children  independent/Math 

140 

Approximate  number  of  children  involved  in 
days  observed 

Math  for  all 

Ul 

Personalized  instruction  in  Math  (Var,  132 

+  i3:i) 

142 

All  children  independent/Math  (Add  Var,  136 

through 

Var.  139) 


106 
107 
108 
109 
110 
111 
112 
113 
114 
115 
116 
117 
118 
119 


*See  Weighting  Scheme  for  CCL  Variables. 


Reading  Groupings:  When  reading  occurs,  what  percent  of  the  time>^ 
is  a  child  in  each  of  tliese  groupings? 


Variable  No.  Description 


14J  One  child  witli  teacIier/Reading 

lAA  IVo  children!  with  teacher/Reading 

1A5  Small  group  with  teacher /Reading 

146  Large  group  with  teacher /Reading 

1A7  One  child  witl^.  aide/Reading 

1A8  Two  children  witli  aide/Reading 

1A9  Small  group  with  aide/Reading 

J 50  Large  group  with  aide/Reading 

151  One  child  with  volunteer/Reading 

152  Two  children  witli  volunteer/Reading 

153  Small  group  witli  volunteer /Reading 

154  Large  group  with  volunteer/Reading 

155  One  child  with  any  adults/Reading 

156  Two  children  witli  any  adults/Reading 

157  Small  group  with  any  adults/Reading 

158  Large  group  with  any  adults/Reading 

159  One  child  independent/Reading 

160  Two  children  independent/Reading 

161  Small  group  of  children  independent/Reading 

162  Large  group  of  children  independent/Reading 

163  Approximate  number  of  children  involved  in  Reading  for 
all  days  observed 

164  Personalized  instruction  in  reading  (Var.  155  +  156) 

165  All  children  independent/Reading  (Add  Var.  159  through 
Var.  162) 


E.      Social  Studies  Groupings:    When  social  studies  occurs,  what  percent 
of  tlie  time^*^  is  a  child  in  eacli  of  these  groupings? 

Variable  No,   ^  Description  


166  One  child  wi th  teache r/ Social  S tudies 

167  T\n70  children  with  teacher/Social  Studies 

168  Small  group  with  teacher/Social  Studies 

169  Large  group  with  teacher/Social  Studies 

170  One  child  with  aide/Social  Studies 

171  Two  children  with  aide/Social  Studies 

172  Small  group  with  aide/Social  Studies 

173  Large  group  with  aide/Social  Studies 

174  One  child  with  volunteer/Social  Studies 

175  Two  children  with  volunteer/Social  Studies 


*Sce  Weighting  Scheme  for  CCL  Variables, 


ERiC 
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CCL  (continued) 

176  Small  group  witii  volunteer/Social  Studies 

177  Large  group  with  volunteer/Social  Studies 

178  One  child  with  any  adults/Social  Studies 

179  Two  children  with  any  adults/Social  Studies 

180  Small  group  with  any  adults/Social  Studies 

181  Large  group  with  any  adults/Social  Studi 

182  One  child  independent/Social  Studies 

183  Two  children  independent/Social  Studies 

184  Small  group  of  children  independent/Social  Studies 

185  Large  group  of  children  independent/Social  Studies 

186  Approximate  number  of  children  involved  in  Social 
Studies  for  all  days  observed 


Science,  natural  world  groupings:    When  science,  natural  world 
occurs,  what  percent  of  the  timc^*^  is  a  child  in  each  of  these 
groupings? 


Variable  No. 

Description 

187 

One  child  with  teacher/Science 

188 

Tv/o  children  with  teacher/Science 

189 

Small  group  with  teacher/Science 

190 

Large  group  with  teacher/Science 

191 

One  child  with  aide/Science 

192 

Two  children  with  aide/Science 

193 

Small  group  with  aide/Science 

194 

Large  group  with  aide/Science 

195 

One  child  with  volunteer/Science 

196 

Two  children  with  voJ unteer/Science 

197 

Small  group  with  volunteer/Science 

198 

Large  group  with  volunteer/Science 

199 

One  child  with  any  adults/Science 

200 

Two  children  with  any  adults/Science 

201 

Small  group  with  any  adults/Science 

202 

Large  group  w;th  any  adults/Science 

203 

One  child  independent/Science 

204 

Two  children  independent/Science 

205 

Small  group  of  children  independent/Science 

206 

Large  group  of  children  independent/Science 

207 

Approximate  number  of  children  involved  in  Science  for 

all  days  observed 

*See  Weighting  Scheme  for  CCL  Variables. 
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Ai'tu  craltb   Koupiru;s:     \:huii  art^,  oralis      ■  u-,,  uihit  percent 
of  the  tLmii'<  Lt>  a  child  in  each  of  these  ^rowp m^'.s  / 

Variable  No.^     ^   Description  

208  One  child  with  teacher/Arts  and  Crafts 

209  'iVo  children  with  teacher/Arts  and  Crafts 

210  Small  group  of  chiJdren  with  teacher/Arts  and  Crafts 

211  Large  group  of  children  with  teacher/Arts  and  Crafts 

212  One  child  with  aide/Arts  and  Crafts 

213  Two  children  with  aide/Arts  and  Crafts 

214  Small  group  of  children  with  aide/Arts  and  Crafts 

215  Large  group  of  children  with  aide/Arts  and  Crafts 

216  One  child  with  volunteer /Arts  and  Crafts 

217  Ti^7o  children  with  volunteer /Arts  and  Crafts 

218  Small  group  with  volunteer/Arts  and  Crafts 

219  Large  group  with  volunteer/Arts  and  Crafts 

220  One  child  with  any  adults/Arts  and  Crafls 

221  T\^70  children  with  any  adults/Arts  and  Crafts 

222  Small  group  of  children  with  any  adults/Arts  and  Crafts 

223  Large  group  of  children  with  any  adults/Arts  and  Crafts 

224  One  child  independent/Arts  and  Crafts 

225  Two  children  independent/Arts  and  Crafts 

226  Small  group  of  children  independent/Arts  and  Crafts 

227  Large  group  of  children  independent/Arts  and  Crafts 

228  Approxima  e  number  of  children  involved  in  Arts  and 
Crafts  for  all  days  observed 


H,      Classroom  Management:     In  what  percent  of  CCL's  do  each  of  th 
occur? 

Variable  No,  Description  

Teacher  involved/Classroom  Management 
Aide  involved/Classroom  Management 
Volunteer  involved/Classroom  Management 


?29 
230 
231 


I.      Social  Interaction:     In  what  percent  of  CCL's  do  each  of  these 
occur? 

Variable  No.  Description 


Among  adults/Social  Interaction 

Among  adults  and  children/Social  Interaction 

Among  children/Social  Interaction 

Between  observer  and  children/Social  Interaction 


232 
233 
234 
235 


*See  Weighting  Scheme  for  CCL  Variables. 


J.      Use  of  Materials  in  Academic  Activities:     In  what  percent  of  CCL^s 
where  an  academic  activity  is  occurring  are  each  of  tiiese  also 
coded? 


Variable  No,  Description 


236  TV/Academic  Activities 

'^37  Audio  visual  equipment/Academic  Activities 

2j8  Exploratory  materials/Academic  Activities 

239  Math  or  science  equipment/Academic  Activities 

240  Texts,  workbooks /Academic  Activities 

241  Puzzles,  games/Academic  Activities 

242  Percent  of  CCL's  in  which  an  academic  activity  is 
occurring/Academic  Activities 


K.      Longitudinal  Variables   (Proportion  of  CCL's  in  which  activity 
occurred) 


Variable  No. 

Description 

2/' 3 

Lunch ,  snack/Longi tudinal 

244 

Group  time/ Longitudinal 

245 

Story ,  music ,  dancing/Longitudinal 

246 

Arts ,  crafts /Longitudinal 

247 

Guessing  games,   table  games,  puzzles/Longitudinal 

248 

Numbers ,  math ,  ari thmetic/Longi tudinal 

249 

Reading,  alphabet,  language  development/Longitudinal 

250 

Social  studies ,  geography /Longi tudinal 

251 

Science ,  natural  wo rid /Longi tudinal 

252 

Sewing,  cooking,  pounding/Longitudinal 

253 

Blocks ,  trucks/Longitudinal 

254 

Dramatic  play,  dress-up/Longi tudinal 

253 

Active  play/Longitudinal 

25^ 

Practical  skills  acquisition/Longitudinal 

257 

Teacher  with  one  child,  academic  acti  ities/Longitudinal 

258 

Aide  with  one  child,  academic  activities/Longitudinal 

259 

Volunteer  with  one  child,  --academic  activities/Longitudinal 

260 

Children  independent,  academic  activities/Longitudinal 

261 

Any  adult  with  one  child,  any  activity/Longitudinal 

262 

Average  number  of  adults  in  the  classroom/Longitudinal 

F-IO 


WLIOHTING  SCHCIL  FOR  CCL  VARIABLES 


PROCLDURE  FOR  ESTABLISH liNG  THE  WEIGHTING  FOR  EAC!1  CCL, 


Let  W 
Let  X 
Let  Y 
Let  Z 


Number  of  one  child  occurrences; 
Number  of  two  children  occurrences; 
Number  of  small  group  occurrences; 
Number  of  large  group  occurrences. 


Let  N 


Let  k 


Number  of  children  present  on  given  day. 

Allocate  a  weight  of  1  to  any  occurrence  of  "one  child" 

AlJocate  a  weight  of  2  co  any  o.  ence  of  "two  children" 
N  -  W  -  2X.     If  Z  =  0  and  Y  =  0,        =  0  and        =  0. 


Where  Wg  is  the  weight  for  any  occurrence  of  "small  group"  and  Wl  is 
the  weight  for  any  occurrence  of  "large  group." 


Weighting:  If  Y  ^  0  and  Z  =  0,  set  Wg 

If  Y  =  0  and  Z      0,  set  Wj^ 


k 

Y 
k 

Z 


Otherwise  (if  Y  ^  0  and  Z  ^  0) 
k  -  5V 


If 


Z 


>  9,  set  V/g  =  5  and  W^  = 


k  -  5Y 


k  -  AY 

Else  if  —         >  9,  set  L'g  =  4  and  W^ 


k  -  AY 


Z 


L  "  Z 

Otherwise,  set  Wg  =  3  and  Wj  =  max  (0,  ^  ^ 


ierJc 
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PRE/VMBLE  (I'Ri:) 


Variable  No. 

Aciult''<  Chilci'^ 

Focu* 

;  l'"ocus 

Description 

A. 

Focus  of  R'lO 

263a 

302c 

Teacher  focus 

Aide  focus 

265a 

Child  focus 

?fi6i 

Group  size :     one  or  two  children 

£,v  /  a 

jUO  C 

Group  size!     small  group 

Group  size:     large  group 

Adult  role 

?69a 

308c 

Teacher  directing 

270a 

309c 

Teacher  participating 

271a 

310c 

Teacher  observing 

9  79o 

311c 

Teacher  not  involved 

^  /  JcL 

312c 

Aide  directing 

313c 

Aide  participating 

*,m   f  ^/<X 

314c 

Aide  observing 

9  7A  o 

/oa 

315c 

Aide  not  involved 

p 
L> « 

Activity /General 

111  ^ 

316c 

Average  number  of  frames  per  FMO 

L.  /  oa 

317c  > 

Number  of  FMO*s  with  lunch  or  snack  as  beginning 

activi  ty 

*.  /  -?a 

318c 

Number  of  FMO's  with  group  time  as  beginning 

activity 

9ftnn 

319c 

Number  of  FMO's  with  story,  music  or  dancing  as 

beginning  activity 

281a 

320c 

Number  of  HIO*s  with  arts  or  crafts  as  beginning 

activity 

282a 

321c 

Number  of  FMO^s  with  guessing  games,  table  games 

or  puzzles  as  beginning  activity 

283a 

322c 

Number  of  FiIO's  with  numbers,  math  jx  arithmetic 

as  beginning  activity 

284a 

323c 

Number  of  FMO's  with  reading,  alphabet  or  language 

development  as  beginning  activity 

285a 

32Ac 

Number  of  FTIO's  with  social  studies  or  geography 

as  beginning  activity 


a*'  indicates  adult  focus  variable,  *'c**  indicates  child  focus  variable. 
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PRC  (continued) 


286a 

325c 

287a 

326c 

283a 

327  c 

289a 

328c 

290a 

329c 

291a 

330c 

292a 

331c 

293a 

332c 

294a 

333c 

295a 

334r 

296a 

355c 

297a 

336c 

298a 

337c 

299a 

338c 

300a 

339c 

301a 

340c 

iMumber  of  FMO's  with  science  or  natural  world  as 
beginning  activity 

Number  of  RIO's  with  sewing,  cooking  or  pounding  as 
beginning  activity 

Number  of  FMO's  with  blocks  or  trucks  as  beginning 
activity 

Number  of  FMO's  with  dramatic  play  or  dress-up  as 
beginning  activity 

Number  of  R-IO's  with  active  play  as  beginning 
activity 

Number  of  FMO's  with  practical  skills  acquisition 
as  beginning  activity 

Number  of  FMO's  with  observing  (independent  children 
only)  as  beginning  activity 

Number  of  FMO's  with  social  interaction  as  beginning 
activity 

Number  of  RlO's  with  unoccupied  child  as  beginning 
activity 

Number  of  FMO's  with  discipline  as  beginning  activity 
Number  of  FMO's  with  transitional  activities  as 
beginning  activity 

Number  of  FMO's  with  classroom  management  as 
beginning  activity 

Number  of  FMO's  \;ith  out  of  room  as  beginning 
activity 

Number  of  FMO's  with  unknot  beginning  activity 
NuiVoer  of  FMO's  which  begin  and  end  in  math 
Number  of  RIO's  which  begin  and  end  in  reading 
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Fivo-Minuto  Observar ion  (KMO) 


V  ci  nuD±u 

iNO  » 

Ko  c  us 

I'  o  c  u  s 

Des^cripCion 

Lhilu  to  adult,  verbai 

/  "7  0  ^ 

AduiL  to  cliild,  verbal 

Lnild  to  adult,  all  verbal  exct^pt  respon.^e 

/.  7 

Individual  child  verbal  interactions  with  -'d.lt 

^  /DC 

Verbal  interactions  among  children 

3^*  6  a 

A77r 

Child  commands,  requests,  and  direct  questions. 

non-academic 

/  d 

A  7ft/^ 

Child  commands,   requests,  and  direct  questions. 

academic 

Child  open-ended  ques tions ,  non-academic 

J^va 

4oUc 

Child  open-ended  questions,  academic 

Child  ques  tions  to  adults 

J^la 

4o2c 

Adult  commands,  requests,  and  direct  questions  to 

groups  of  children,  non-academic 

/.  Q  T  ^ 

Adult  commands,  requests,  ana  direct  questions  to 

individual  children,  non-academic 

J  J  Ja 

/  Q/  , 

^o^c 

Adult  commands,  requests,  and  direct  questions  to 

groups  of  children,  academic 

Adult  commands,   requests,  and  direct  questions  to 

individual  children,  academic 

jDjQ. 

^ODC 

Adult  open-ended  questions  to  children,  non-academic 

JDUdi 

/  C 

Adult  open-ended  questions  to  children,  academic 

/  a 

^  ooC 

All  adul t  questions  to  children 

J  J  oa 

VC 

All  children  responses 

Child  responses,  non-academic 

^Dua 

Child  responses ,  academic 

jola 

4yzc 

Child  responses  to  behavioral  correction  or 

reinforcement 

jo*:a 

4y  jc 

Individual  child  responds  to  adult  academic  command, 

reques  t ,  or  di  rec  t  ques  tions 

jO  ja 

Child  group  responds  to  adult  academic  request  or 

direct  question 

36  4  a 

Adult  responses  to  child  requests  or  questions. 

academic 

365a 

Adult  responses  to  child  requests  or  questions. 

non-academic 

366a 

497c 

Adult  responds  to  child  question  with  open-ended 

question 

36  7a 

498c 

Adult  responds  to  child  question  with  direct  question 

368a 

409  c 

Child  responses  to  adult  open-ended  questions 

*"a"  indicates  adult  focus  variable,  "c"  indicates  child  focus  variable. 
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FMO  (continued) 


369a 

500c 

ijALenueci  response ,  non-academic 

370a 

501c 

Child 

c A LL.nueu  respons e ,  acaciomi c 

37  la 

502c 

{'hi  1  (1 

uxLunueci  response  to  adult  open-ended  question 

372a 

"A)  3c 

Child 

pico^'iiuxii^  xiii. UL mdL xun  lo  a  group 

373a 

504c 

Adult 

X 1 L 1.     L X uii ,  I  un  cic<iQemic 

374a 

535c 

Ad  u  1 1 

xii^>  L  L  UL  t  xon ,  acaciemic 

375a 

306c 

xnsLruLLb  an  inuivicluai  cnild 

376a 

507c 

Adult 

instructs  a  group 

377a 

5t)8c 

Child 

self-ins  true t ion 

378a 

509c 

Ciiild 

self -instruct ion,  academic 

379a 

510c 

Child 

i.elf-ins  true  Lion,  ohjr>c  ts 

380a 

311c 

Child 

self-instruction,  academic,  with  objects 

381a 

512c 

Child 

instructing  another  child 

382a 

513c 

Child 

task  persistence 

383a 

314c 

Two  children  working  together,  using  concrete 

ob j  ects 

384a 

515c 

Small 

group  working  together,  using  concrete 

objects 

385a 

316c 

Social  interaction  among  children 

386a 

517c 

Child 

task-related  comments  to  children 

387a 

518c 

Child 

general  comments  to  adults 

388a 

519c 

Chi  Id 

task-related  comments  to  adults 

389a 

520c 

Adult 

general  comments  to  children 

390a 

521c 

Adult 

task-related  comments  to  children 

391a 

522c 

Child 

acknowledgment 

392a 

523c 

Child 

praise 

393a 

524c 

Child 

corrective  feedback 

394a 

525c 

All  adult  acknowledgment  to  children 

395a 

526c 

Adult 

acknowledgment  to  children,  academic 

J  J  \J  Qt. 

Adult 

acknowledgment  to  children,  behavior 

397n 

528c 

Adult 

acknowledgment,  other  task-related 

398a 

529c 

All  adult  praise  to  children 

399a 

5  JOc 

Adult 

reinforcement  with  token,  academic 

400a 

531c 

Adult 

reinforcement  with  token,  behavior 

332c 

Adult 

reinforcement  with  token,  other  task-related 

402  a 

3  33c 

Adult 

praise,  academic 

403a 

534c 

Adult 

praise,  behavior 

404a 

535i. 

Adult 

praise,  other  task- related 

405a 

536c 

All  adult  corrective  feedback  to  children 

406a 

537c 

Adult 

positive  corrective  feedback,  academic 

407a 

538c 

Adult 

negative  corrective  feedback,  academic 

408a 

3j9c 

Adult 

positive  corrective  feedback,  behavior 

409a 

540c 

Adult 

negative  corrective  feedback,  behavior 

410a 

541c 

Adult 

positive  corrective  feedback,  other  task- 

related 
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FMO  (continut'd) 

411a  b^lc  Auult  negative  corrective  feedback,  other  tarsk- 

related 

41Ja  34  3c  Adult  feedback  to  child  response  to  adult  academic 

command  or  question 

413a  544c  Child  not  responding  to  adults 

414a  545c  Adult  not  responding  to  child 

415a  546c  Child  waiting 

416a  547c  Children  attentive  to  adults,  non-academic 

417a  548c  Children  attentive  to  adults,  academic 

418a  549c  Adults  attentive  to  children,  non-academic 

419a  350c  Adults  attentive  to  children,  academic 

420a  531c  Adults  attentive  to  a  small  group 

421a  552c  Adults  attentive  to  individual  children 

422a  553c  Positive  behavior  among  children 

423a  55^c  Positive  behavior,  adults  to  children 

424a  555c  Positive  behavior,  children  to  adults 

425a  556c  Child  expressions  of  unhappiness 

426a  557c  Adult  expressions  of  unhappiness 

427a  538c  Negative  behavior  among  children 

428a  559c  Negative  behavior,  adults  to  children 

429a  560c  Negative  behavior,  children  to  adults 

430a  561c  Total  adult  affect 

431a  562c  Total  child  affect 

432a  563c  Adult  punishment  of  children 

433a  564c  Child  statements  of  self-worth 

434a  565c  Dramatic  play,  pretending 

435a  566c  Total  academic  verbal  interactions 

436a  567c  Total  interactions,  behavior  control 

437a  568c  Children  engaged  in  mutual  activity 

438a  569c  Adult  communication  or  attention  focus,  one  child 

439a  ">70c  Adult  coramunication  or  attention  focus,  two  children 

440a  571c  Adult  communication  or  attention  focus,  small  group 

441a  572c  Adult  communication  or  attention  focus,  large  group 

442a  573c  All  child  nonverbal 

443a  57^ic  Child  movement 

444a  575c  Adult  movement 

445a  576c  Adult  leaving  the  room 

446a  377c  Child  attentive  to  machine 

447a  578c  Adult  neutral  corrective  feedback,  task-related 

448a  579c  Adult  neutral  corrective  feedback,  behavior 

449a  580c  Adult  neutral  corrective  feedback,  academic 

450a  581c  All  child  open-ended  questions  (Var .  348a  -H  349a 

and/or  Var.  479c  +  480c) 

45 la  5S2c  Adult  academic  commands,  requests,  and  direct 

questions  to  children  (Var.   353a  +  354a  and/or 

Var.  484c  +  485c) 

4' 2a  583c  Adult  open-ended  questions  to  children  (Var.   355a  + 

356a  and/or  Var.  486c  +  487c) 

453a  584c  Adult  response  to  child's  question  with  a  question 

(Var.   366a  +  367a  and/or  Var.  497c  +  498c) 

454a  585c  Child's  extended  response  to  questions  (Var.   369a  + 

370a  +  371a  and/or  Var.  500c  +  501c  +  502c) 
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^10  (continued) 


455a  586c  All  adult  instruction  (Var.  373a  +  37^a  and/or 

Var.  504c  +  505c) 

456a  587c  All  child  task-rtilated  comments  (Var.   386a  +  388a 

and/or  Var.  517c  519c) 
457a  588c  All  adult  positive  corrective  feedback  (Add  Vars. 

406a,  408a,  410a  and/or  53/c,  539c,  541c) 
458a  589c    •       All  adult  negative  corrective  feedback  (Add  Vars. 

407a,  409a,  411a  and/or  538c,  540r.,  542c) 
459a  590c  All  adult  praise  for  academic  responses  (Var.  399a 

+  402a  and/or  Var.  530c  +  533c) 
460a  593c  All  diild  positive  affect  (Var.  422a  +  424a  and/or 

Var.  553c  +  555c) 

461a  592c  All  child  negative  affect  (Var.  427a  +  429a  and/or 

Var.  558c  +  560c) 

462a  593c  All  positive  behavior  (Add  Vars.  422a,  423a,  424a 

and/or  Vars.  553c,  554c,  555c) 
463a  594c  All  negative  behavior  (Add  Vars.  427a,  428a,  429a 

and/or  Vars.  558c,  559c,  560c) 
464a  595c  Child  attentive  (Add  Vars.  416a,  417a,  446a  and/or 

Vars.  547c,  548c,  577c) 
465a  596c  Adult  feedback  to  children  for  behavior  (Add  Vars. 

396a,  403a,  408a,  409a,  448a  and/or  Vars.  527c,  534c, 

539c,  540c,  579c) 
466a  597c  Child  self-esteem  (Add  Vars.  392a,  393a,  433a, 

454a  and/or  523c,  524c,  564c,  585c) 
467a  598c  Child  cooperation  (Add  Vars.  381a,  38r:a,  437a  and/or 

Vars.  512c,  517c,  568c) 
468a  599c  Child  self-instruction,  non-academic  (Var.   377a  - 

378a  and/or  Var.  508c  -  509c) 
469a  600c  All  adult  reinforcement  with  tokens  (Add  Vars.  399a, 

400a,  401a  and/or  Vars.  530c^  531c,  532c) 
470a  601c  All  adult  neutral  corrective  feedback  (Add  Vars. 

447a,  448a,  449^:  and/or  578c,  579c,  580c) 
471a  602c  Adults  attentive  to  large  group  (Subtract  sum  of 

Vars.  420a  and  421a  from  sum  of  Vars.  4l8a  and 

419a  and/or  subtract  sum  of  Vars.  551c  and  552c 

from  sum  of  Vars.  549c  and  550c) 
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Appendix  G 

CLASSROOM  OBSERVATION  VARIABLE  SPECIFICATIONS 


Appendix  G 


CUSSROC^  OBSERVATION  VARIABLE  SPECIFICATIONS 


There  are  five  categories  of  classroom  observation  variables: 

I-Classroom  Summary  Information  (CSI) 
Il-Physical  Environment  Information  (PEI) 
Tll-Classroom  Check  List  (CCL) 
IV-Preamble  (PRE) 
V-Five  Minute  Observation  (FMO). 

The  computations  of  the  variables  in  each  category  are  based,  for  the  most 
part,  on  information  obtained  from  the  corresponding  section  of  the  Classroom 
Observation  Instrument.     The  variables  are  numbered  consecutively  through  the 
list.     Ir  the  text  the  variable  number  will  usually  be  accompanied  by  one  of  the 
abbreviations  given  above  to  indicate  the  category  that  the  v£riable  came  from. 
The  variable  spec  if  ic.**:lons  given  here  are  how  the  variable  was  computed  at  the 
classroom  level,  the  '.evel  of  the  unit  of  the  analysis  for  most  of  the  current 
evaluat  ion . 


^ •     Classroon  Summary  Information  (CSI) 

(^ne  CSI  is  completed  per  day  of  observation. 


Variable  No. 


Description 


5 
6 
7 
8 
9 
10 
1  i 
IJ 
13 


Soonsor  code 
Site  code 
Center  code 
Teacher  code 


Orade  Hither  1  or  3 

Observer  code 


Classroom  identification  data 
>    obtained  from  the  first  day  of 
observation . 


N'ot  used  in  the  analysis. 


^    Obtained  from  the  first  day  of 
observation . 


N'ot  used  in  the  analysis. 


umber  of  children  enrolled 
umber  of  children  present 
unber  of  teachers 

Number  of  aides 

N'anber  cf  volunteers  present  j 


y  Averaged  over  days  of  observa- 
tion . 


'ar labltf  No. 
15 

16 


Description 


Child/teacher  and  aide  ratio 
(Nunber  of  c'hildren  divided 
by  number  ot   teachers  and 
aides) 

Child/adult  ratio  (Nunber  of 
children  divided  by  number 
of  teachers ,  aides ,  and 
volunteers) 

Total  class  duracion 


y  Computed  for  each  day  and  then 
averaged  over  days  of  observation. 


Averaged  over  days  of  observa- 
tioii. 


1 .     Physical  Environment  Information  (PEI) 

One  Pri  is  completed  per  day  of  observation. 


Variable  No. 


18 


Description 


19 
20 

21 


23 


Movable  tables  and  chairs  for 
seating 

Statiorary  desks 'in  rows 

Assigned  seating  for  at  least 
part  of  the  day 

Children  select  their  own 
Seat  ing  locat  ions 

Teacher  assigns  children  to 
^rouDb 

Children  select  their  own 
work  groups 

Child  selection  of  seating 
and  work  groups 


1  if  marked  1  on  any  day  (indi- 
y  eating  "yes"  or  "present"); 
0  otherwise. 


n-V20)  +  V2I  +  (1-V22)  +  V23 
Range: 


Lnless  otherwise  stated  below,  each  of  the  remaining  PfJ  variables  was  coded 

as  folloi;s: 

If  "present"  is  in  the  variable  name,  the  variable  had  a  value  ot  1  if  the 
corresponding  iten  on  the  ?VA  had  been  marked  "present"  or  "used"  on  any  day  of 
observation;  otherwise,   the  variable  had  a  vjlue  of  0. 

If  "used"  IS  m  the  variable  name,  the  variable  had  a  value  of  1  if  the 
t  or**espond  ing  item  on  the  PF",I  had  been  narked  "used  today"  on  any  day  of  obser- 
vation: otherwise,  the  vari<ible  iiad  a  value  of  0. 
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:  '  tr 


25 

26 

27 

28 
29 

30 

n 

32 
33 


35 
36 
37 
38 
39 


41 


Canes,   toys,  piav  equipment 
pre<  --it 

Gafi.t    ,   Luvb,  plav  euuipment 
used 

Instructional  materials 
present 

Instructional  nateriais  used 

Montessori,  other  educational 
toys  present 

Monte^iiori,  other  educational 
toys  used 

Ch  i  Idren  *  s  texts ,  workbooks 
present 

Children's  text^,  workbooks 
used 

Matii/Science  equipment,  con- 
crete objects  present 

!iatr /Science  equipnent,  con- 
crete objects  used 

Instructional  charts  present 

Instructional  charts  used 

Audio  visual  equipment  present 

Audio  visual  equipment  used 

General  equipment,  materials 
present 

General  equipment,  materials 
used 

Children's  own  products  on 
display 

Displays  reflecting  children's'' 
ethnici  tv 


Hach  Item  under  this  heading  for 
the  Pi:r''  was  scored  as  specified 
above  and  the  scores  were  summed 
^  across  items.     Range:  0-10. 
See  specification  of  variables 
25,  26.     Range:  0-4. 


See  specification  of  variables 
25,  26.     Range:  0-3. 


See  specification  of  variables 
25,  26.     Range:  0-12. 


Coded  as  "present"  variable. 


43 


Photographs  of  the  children 
present 


^  Coded  as  "present"  variable. 


See  Appendix  C,  The  Classroom  Observation  Instrument 


Variable  N 


i)oscrij)L  ion 


4h 


48 
A9 
50 

51 

52 

53 

54 
55 
56 
57 
58 

59 
60 


local  niinber  of  different 
rt»j>ourc'e  4Mrt»i;v')r  ies  cocied 
*'presfnc"  over    )  day:r> 

Total  number  of  different 
resource  categories  coded 
"used  today"  over  3  days 

Number  of  COPs — adult  focus 


Number  of  C(>Ps--chi!d  fjcus 

Achievepent  charts  present 

/Achievement  charts  used 

Cooking  and  sewing  supplies 
present 

Cooking  and  sewing  supplies 
used 

Carpentry  materials,  large 
blocks  present 

Carpentry  materials,  large 
blocks  used 

Sandbox,  water  table  present 

Sandbox,  water  table  used 

Magazines  present 

Magazines  used 

Children's  story  books 
present 

Chilciren's  story  books  used 
Total  number  of  CCLs 


V25  +  V27  +  V37  +  V39. 


V26  +  V28  +  V38  +  V40. 


The  number  of  COPs  used  in  the 
computations  of  the  FMO  variables 
on  adu 1 t /act ivity  focus." 

The  number  of  COPs  used  in  the 
computations  of  the  FMO  variables 
on  child  focus. 


The  number  ol  CCLs  used  in  the 
computation  of  the  CCL  variables. 


Ihese  do  not  appear  in  the  PKI,  but  were  calculated  in  the  process  of  creating 
the  cl ass room- 1  eve  1  data  tape. 
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3.      Classroom  Check  List  (CCl.) 


Approximately  20  CCLs  are  completed  per  day  of  observation.     The  data  from 
the  CCL  consists  of  the  number  of  configurations  of  adults  and  children  that  were 
engaged  in  a  partuular  .utivity  aI  the  time  the  CCL  was  complettd.     A  configura- 
tion is  defined  by  the  number  of  children  (either  one  child,  two  duldren,  small 
group,  or  large  group)  and  the  adults  involved,   if  any  (either  teacher,  aide* 
volunteer,  or  independent,  with  independent  indicating  that  no  adults  are  involved). 
Since  the  number  of  children  involved  in  any  given  activity  can  only  be  determined 
up  to  a  small  group  or  large  group  designation,  a  weighting  scheme  was  devised  to 
obtain,   for  each  CCL  separately,  the  approximate  size  of  small  and  large  groups 
when  they  occurred. 

The  procedure  for  establishing  the  approximate  size  of  the  groups  for  a  CCL 
was  as  follows: 

The  number  of  conf iguri^tions  or  groups  observed  was  tallied  for  each 
group  size  across  al !  activities. 

Let    W  =  Number  of  one-child  configurations 

X  =  Number  of  two-children  configurations 

Y      Number  of  small  group  configurations 

Z  =  Number  of  large  group  configurations 

Let    N  =  Number  of  children  present  for  the  day  (Taken  from  the  Class- 
room Summary  Information  item  "Number  of  children  present 
today. ") 

A  weight  of  1  was  allocated  to  any  occurrence  of  "one  child." 

A  weight  of  2  was  allocated  to  any  occurrence  of  "two  children." 

Let    k  =  N-W-2X       This  represents  the  number  of  children  who  were  in 
either  a  small  or  large  group. 

If  Y      0  and  Z  =  0  (i.e.,   there  were  no  large  groups),   then  a  weight 
of  k/Y  was  allocated  to  each  small  group. 

Tf  Y  =  0  and  7   -  0  (i.e.,   there  were  no  small  groups),  then  a  weight 
of  k/Z  was  allocated  to  each  small  group. 

When  Y    ^  0  and  Z   -  0  (i.e.,  there  were  both  large  and  small  groups): 

if  (k-5Y)/Z  ^  9,  then  a  weight  of  5  was  allocated  to  each  small  group 

and  (k-5Y)/Z  was  allocated  to  each  large  group; 
if  (k-4V)/Z  _  9,  then  a  weight  of  4  was  allocated  to  each  small  group 

and  (k-4Y)/Z  was  allocated  to  each  large  group: 
otherwise,  a  weight  of  3  was  allocated  to  each  small  group,  and 

(k-3Y)/Z  was  allocated  to  each  large  group. 

In  this  last  case  if,  because  of  an  error  in  observation  or  coding, 
K      3Y,  a  weight  of  zero  was  allocated  to  large  groups. 

This  algorithm  assigns  5  children  per  small  group  unless  this  will  be  incon- 
sistent with  the  assignment  of  number  of  children  in  large  groups,  which  must  be 
at  least  9.     If  there  is  an  inconsistency,  the  assignment  to  si^all  groups  is 
dropped  to  4  and  the  number  of  children  assigned  to  large  groups  is  checked  again. 
If  the  inconsistency  still  remains,  a  value  of  3  is  assigned  to  the  number  of 
children  in  a  small  group. 
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Classroom  Activities 


I  "lie  apin'oxiiua»"e  number  of  c^hihlren  'uigaged  in  a  given  activity  on  a 
pare  I  (.  ul  ar  ("CM  will  be 

n.  +  2n^  +  IC  •  n    +  U\  •  n, 

1  2        s    s        I  L 

wh.iire  Wj,  and  V'j  are  the  approx inui te  sizes  of  small  and  large  groups,  respect ivel v , 
and  n|,  x\y,  and  uj   are  the  nunber  of  one-cl^lld,  two-children,  small  group, 

and  large  group  lot  f  igurat  iokj?  tl)at  are  engaged  in  tl)e  particular  activity.  Vari- 
ables 61  through  81  are  defined  as: 

J SuiV.  ovsr  all  CCLh  approximate  number  of  children  in  the  given  activit 

Sum  ovt r  all  CX'Ls  of  the  number  of    hildren  present 

i:ach  of  these  vai  iables  represents  the  percent  of  "child  time"  that  is 
spent  in  a  given  activity.  '^^um  of  variables  61  through  81  will  be  100, 

Variable  No.         _    Description  


61  Lunch ,  snack 

62  Group  time 

6'^  Storv,  music,  dancing 

64  Arts,  crafts 

65  Guessing  games,  table  games,  puzzles 

66  Numbers,  math,  arithmetic 

67  Reading,  alphabet,  language  development 

68  Social  studies,  geography 

69  Scie*  *e,  natural  world 

70  Sewing,  cooking,  pounding 

71  Blocks,  trucks 

72  Dramatic  plav,  dress-up 
7  3  Active  play 

7A  Practii^al  skills  acou is i t ion 

75  C  ^ervjng  (independent  children  only) 

7b  Social  interactioii 


Variable  Mo. 


11 

Unoccupied  child 

78 

1)  i  sc  ip  1  ine 

79 

Trans i  t  ional  aci t  ivi t  ies 

80 

Classroom  management 

81 

Out  of  room 

Variables  82  and  83  are  measures  of  the  number  of  different  activities 
that  occur.     Only  the  first  fourteen  activities  as  listed  on  the  CCL  are  included. 

82  Wide  Variety  of  activities,  concurrent. 

For  each  CCL,  each  activity  gets  a  score  of  1  if  any  child 
was  engaged  in  the  activity;  otherwise  a  score  of  zero  is 
assigned.    The  scores  for  the  activities  are  summed  for  each 
CCL  and  then  the  average  per  CCL  is  obtained.     Range  0-14. 

83  Wide  variety  of  activities,  over  one  day. 

For  each  day,  each  activity  gets  a  score  of  1  if  any  child  is 
observed  to  engage  in  the  activity;  otherx^^ise  a  scoie  of  zero 
is  assigned.     The  scores  for  the  activities  are  summed  for 
each  day  and  then  the  average  per  day  is  obtained. 
Range:  0-14. 

84  Approximate  number  of  children  in  the  classroom  in  any  activity. 

The  total  weight  allocated  for  each  day  is  defined  as  the  num- 
ber of  children  present  multiplied  by  the  number  of  CCLs  com- 
pleted for  the  day.    Variable  84  is  defined  as  the  sum  of  the 
total  weight  across  days  divided  by  the  total  number  of  CCLs 
observed  (Var.  60).     It  should  correspond  closely  to  the  average 
number  of  children  precent.  * 

b .       C I a s s r o om  Groupings 

This  section  contains  variables  that  describe  the  percent  of  "time" 
spent  by  adults  and  children  in  particular  grouping  patterns.     Variables  85 
through  108  relate  to  the  amount  of  time  adul t^  spend  in  particular  groupings. 
Variables  109  through  118  relate  to  the  amount  of  time  children  are  found  in 
part    ular  groupings. 

The  set  of  vaiiables  dealing  with  adults  consists  of  four  subsets  deal- 
ing wLLu  the  teacher,   the  aide,  the  volunteer,  and  all  adults,  respectively.  Each 
subset  consi::>ts  of  six  variables.     The  specifications  for  eacn  subset  are  as  fol- 
lows : 

The  number  of  occurences  of  the  specified  adult  (or  adults)  in  each 
specified  grouping  pattern  (without  children,  one  child,  two  chil- 
dren, small  group,  and  large  group)  is  tallied  across  all  CCLs. 
The  tallies  are  summed  across  grouping  patr^^rns  to  yield  the  ov^^r- 
all  occurrences  (Variables  90,  96,   102,  or  108).     The  tally  for 
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tVK  h  s|Hnitit^d  uri'ipin;^  patttrn  is  ihen  div'ded  by  the  overall 
oc  i  urrt- r.^ts  anJ.  ilit-n  null  ip  I  led  bv  100  to  yield  the  percent  of 
overall  v->orur  ren».  es  in  each  particular  grouping  pattern.     If  the 
nu'^her  .^f  ovtr-rill       .  urren*.  es  equals  zero,  then  the  percent  of 
occurreni       i  t  ea*  ii  parti(ular  grouping  pattern  is  set  to  zero, 


VarLihle  No.  ^ llr^il 

85  Teacher  w  1  tiiout  ch  i  1  dren 

vSb  Ieach<.'r  with  onv  '.^iild 

87  leather  u'lth  tvv'o  children 

88  ItMi^hcr  with  snail  group 

89  leacher  with  la.rge  group 

90  (K'urall  teacher  occurrences 

91  Aide  without  chihiren 

92  Aide  with  one  child 

9  3  Aide  with  two  children 

94  Aidt-  with  srva  1 1  group 

95  Aide  with  large  group 

9b  l>verall  aide  ocLurrt^pAes 

97  Volunteer  wMthout  children 

98  Volunteer  with  one  child 

99  Volunteer  with  two  cliildren 

100  Volunteer  with  small  group 

101  Volunteer  w^th  large  group 

102  Overall  volunteer  occurrent  es 

103  Adult  witiiout  children 

104  Adult  with,  one  child 
U>5  Adult  with  two  children 
1U(>  Adult  with  sna.  11  grc^up 
107  Adult  with  large  group 

lOK  Overall  oecurreuies  of  adults 


(.-10 


The  set  of  variables  dealinji^  with  children  erploys  the  weighting  scheme 
Jest^ribed  at  the  beginning  of  the  CCI   section  on  p.  C-5.     The  specifications  for 
Variables  109  through  116  are  as  follows: 

The  approximate  nanibers  of  eb.ildren  who  are  observed  in  the  given 
grouping  pattern  are  sunined  acioss  all  CCls.     This  sum  is  then 
divided  bv  the  total  weight  and  multiplied  by  100  to  yield  the 
percent  of  "child  line"  spent   m  a  given  grouping  pattern.  The 
total  weight  is  defined  as  the  sum  across  CCLs  of  tl.e  number  of 
children  present.     The  total  weight  is  given  in  Variable  119. 


Variable  No.   ^   l)escr^ip_t_i_on  

109  One  child  with  any  adult 

110  Two  children  with  anv  adult 

111  Snail  group  of  children  with  any  adult 

112  Large  group  of  children  with  any  adulc 

113  Overall  occurrence  of  children  with  any  adult 
11"^  One  child  independent 

115  Two  children  independent 

116  Small  group  of  children  independent 

117  Large  group  of  children  independent 

118  .All  children  independent  Variables  lU  +  115  +  116  +  117 

119  Number  of  children  in  the  classroom  times  the  number  of  CCLs 


The  specifications  of  the  variables  for  Math  groupings,  Reading  group- 
ings. Social  Studies  groupings,  Science  and  Natural  World  groupings,  and  Arts, 
Crafts  groupings  are  similar  to  those  for  Classroom  groupings.     The  weighting 
scheme  described  on  p.  G-5  is  used.     The  specifications  for  the  first  21  vari- 
ables in  each  of  these  sections  are  a6-  follows: 

The  approximate  number  of  children  who  are  observed  in  the  given 
grouping  pattern  in  the  given  activity  are  summed  across  all  CCLs,  - 
This  sum  is  then  divided  by  the  total  weight  for  the  g  i y  e  n  a c  t  i  v  i  ty 
and  multiplied  by  100  to  yield  the  percent  of  "child  time"  spent 
in  a  given  grouping  pattern  when  the  given  activity  is  occurring. 

The  total  weight  for  the  given  activity  is  computed  by  summing 
across  CCI s  the  approximate  number  of  children  engager  in  the 
activity.    The  variable  "Approximate  number  of  children  involved 
in  given  activity  for  all  days  observed"  is  this  total  weight 
(Variables  UO,   163,  186,  207,  and  228). 

Note  that  the  variables  in  Sections  C  through  G  indicate  how  much 
of   i  grouping  pattern  is  'ised  when  a  given  activity  is  occurring. 
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rhev  do  not  refK^ct  the  amount  of  tho  activity  that  is 
observed  to  cnrur.     Uw  percent  o\    "child  tine"  spent 
in  each  actlvit\  v;a^  given  in  Part  3-a. 


Math_  (Iroup  iri^s 


Vai'lcibje  N\). 
120 
121 
122 
123 
124 
125 
126 
127 
128 
129 
130 
i3i 
132 
133 
134 
133 
136 
1  V 
1  38 
i  ^9 
UO 

Ul 
142 


1) 


t.'hc  r  iJ^^tjLon 


One  ^h.  lid  u'iLb.  Lea^  her/''ath 

Iwo  childrt-n  with  teacher /''lath 

Sma 11  group  vi th  teacher /Math 

Large  group  with  teacher /Math 

Ope  child  with  aide/Math 

Two  children  with  aide/Math 

Snail  group  with  aide/Math 

Large  group  with  aide/Math 

i^ne  child  with  vo lunteer /''lath 

Two  children  with  volunteer/Math 

Small  group  with  volunteer /Math 

Large  group  with  volunteer /Math 

One  ci^ila  with  any  adults/Math 

Two  children  with  any  adults/Math 

Snail  group  with  any  adu  1  tb/''Iath 

Large  group  with  anv  adults/Math 

One  ch  1  Id   independent /Math 

Iwo  ch i  Idren  i ndt -jendt  nt  /Matii 

Small  group  of  chil   .en  i ndepe^^^ent /Math 

Large  group  of  cld  Idren  independent  /''lath 

Approx  imat"  n'l^b        f  ch  i  Idren  invol  v*^^^ 
in  Math — all  days  observed  J 


y  See  text  in  Part  3-a. 


Personal ized  instruction  in  Math 
All     h  i  1  d  r  e  n  i  n d  e  p e  n d  e  n  t  /  Ma  t  h 


Var.   132  +  133 

Var.   136  +  1  37  +  138  +  ! 


G-i: 


er|c 


Read  i  ng  G  r ou p I ngs 


Varijible  No. 
U3 
14A 
145 
146 
147 
148 
149 
150 
151 
152 
153 
154 
155 
156 
157 
158 
159 
160 
161 

162 

163 

164 
165 


ySee  text  in  Part  3~a. 


^ .  _  .  „  .        I)e s c rjp t^o  11^ 

One  child  with  teacher/Reading 

Two  children  with  teacher/Reading 

Small  group  wirh  teacher /Read ing 

Large  group  with  teacher /Read ing 

One  child  with  aide/Reading 

Two  children  witn  aide/Reading 

Small  group  with  aide/Reading 

Large  group  with  aide/Reading 

One  child  with  volunteer /Read ing 

Two  children  with  volunteer/Reading 

Small  group  with  volunteer/Reading 

Large  group  with  volunteer/Reading 

One  child  with  any  adults/Reading 

Two  children  with  any  adul rs/Reading 

SiTiali  group  with  any  adu_  ts/Reading 

Large  group  with  any  adults/Reading 

One  child  independent/Reading 

Two  children  Independent/Reading 

Snail  group  of  children  independent,/ 
Read  ing 

Large  group  of  children  independent/ 
Read  ing 

Approxirr^ate  number  of  children  involved 
in  Reading — all  days  observed 

Personalized  instrucM'n-.  in  Reading      Var.  155  +  156 

All  children  independent/Reading  Var.  159  +  160  +  161  +  162 


ERIC 
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.4 


Variable  No. 
106 
167 
168 
169 
170 
171 
1  "J 
173 
174 
175 
176 
177 
178 
179 
180 
181 
I8j 
18  3 

1H5 
186 


Df^se  r  ijU  ion 

One  <hiUI  with  tf<i<  Irt  '  So<.  i  a  1  Studies 

iuo  children  with  t <.'•.<  h.t^r/ Sot  lal  Studies 

Snail  group  with  to«ioher /SotMal  Studies 

Large  grouj)  with  t  earher /Sue  i  a  1  Studies 

'^ne  child  with  aide/Social  Sciidieb 

hv'o  children  with  aide /Social  Studies 

Snail  group  with  aide/Sooial  Studies 

Large  group  with  aide/Social  Studies 

One  child  with  volunteer /Social  Studies 

Two  children  with  vol  un  teer /Soc  i  a  1  Studie.^ 

Small  group  with  volunteer/Social  Studies 

Large  group  with  volunteer /Soc ' a  1  Studies 

One  child  with  any  adults/Social  Studies 

Two  children  with  anv  adul ts ^Social  Studies 

SiT.all  group  with  any  adults/Social  Studies 

Large  group  with  any  adults/Social  Studies 

One  ( h i Id   independent /Soc la 1  Stud  ies 

I'vvO  eiiildren  nuiependent/Su(  i«i  1  Studies 

Sr".  1 1  1  group  of  i  iiildreti  independent /So<  lal 
Stud  ies 

Large  group  of  ciiildren  i ndependent /Soc  la  1 
Stud  ies 

Approx  incite  nunber  of  children  involved  in 
Social  Studies~-all  davs  observed 


y  See  text   in  Part 
3-a. 


ERIC 


y ar la  t 
187 
188 
189 
190 
191 
192 
193 
194 
195 
196 
197 
198 
199 
200 
201 
^202 
203 
204 
JOS 

206 

207 


^   _  ^   _    Desc ript^ion 

One  ohiid  wiLli  cea<,  luT /Soieiu  e 

Two  children  witli  teaU^er/Sc ience 

Small  group  with  teacher /Sc ience 

Large  group  with  teacher /Sc ience 

One  child  with  aide/Science 

Two  children  with  aide/Science 

Small  group  with  aide/Science 

Large  group  with  aide/Science 

One  child  with  volunteer /Sc ience 

Two  children  with  volunteer/Science 

Small  group  with  volunteer /Sc ience 

Large  group  with  volunteer /Sc ience 

One  child  with  any  adui ts/Sc ience 

Two  children  with  any  adults/Science 

Sr^'^i]  group  with  any  adults/Science 

Large  group  with  any  adults/Science 

One  child  independent/Science 

Two  chiidrc.i  independent /Science 

Snail  group  of  children  independent/ 
S'Uence 

Large  group  of  children  independent/ 
Sc  ience 

Annroxinace  number  of  :hildren  in- 
volved in  Science — all  days  observed 


y  See  text  in  Part  3-a. 
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ar  i  lb  1 » 
JOH 


!13 


J16 


218 


^2  5 


lU's.  r  ipt  !on 

niu>  I.  ilh  t«.Mih<'r  Arts  aiui  Cral  t-> 

Iw.^  (iiilaii'ii  v;iin  u^a^  I't-r/Ar  t  s    itkI  (raft-^ 

"^luiJi  ^ri'Ut^  L''   >hiIJrt'n  uith  It-^a^  tier/ \r  t 
aiM  iritis 

l.jr^t'  ^rotip        ttuKlrcn  \:it\i  it- ht- T/ Arts 
ar.d     J  ii  I  ^ 

i'nv  V  in  Kl  with  a;dt/\rt-  anti  (  raJcs 

v!>ildrfn  'v.'itn  iidt'/Art^  a:id  (rafts 

Snail  group  of  ("hildren  i/ith  aide/Arts  and 
Crafts 

i.afj^t*  grtMjp  of  »*hildren  with  aide/ Arcs  and 
(.rafts 

One  tiMid  with  volunteer  ^\rts  and  Crafts 

l'v\'  children  v.itb  V( ■  1  un t*-er Ar t s  and  (rafts 

v'^'^all  ^rour>  of  f:^)ildren  witii  volunteer /Arts 
inJ  f  r  ii  t.^ 

*  ari?t'  gr.M*''  fiildrvn  Vc^  1  unt  t-e  r  ^\r  l  s 

itld  (  rat  t-- 

'>niL'  vhild  with  an*v  adults/Arts  and  Crc'ft^ 

iwo  children  with  any  adults/Arts  and  Crafts 

Sriall  ^r.  'ip  with  anv  adults  ^\rts  and  Crafts 

1  argt-  group  of  children  with  an\  aciults/Arts 
ind  Craf  t  s 

.hild  independent/Arts  an-!  Crafts 

I'.,'''  <  'M  Idren  independent /'\rts  and  ^.rafts 


See  text  in 
Fart  3-a. 


a  i  I  ^^r.MiP 
'^r  \\  t  -V 


nildren  i nd up t-ndt-nt /Arts  and 


1  ir^v  >:ro>u^        if'ildr»'n  i  ndt  d^mi  i^'U  t  'Ar  t  s  and 

'  i>prox  i'\att  n'<rber  of  ^htildrtn  involved  in 
\r  ts/Craf  I  s --a  1  1  davs  (observed 


ERiC 


231 


Hes^^r  i  ion 


ItNivber  mvolvt'vi 'Classroom  Management 
A I de  I nvo 1 ved / C I  ass  room  Managemen  t 
Voluntt-er  involved /CI  ass  room  Management 


100 


Number  of  CCLh 
where  given  adult 
is  engaged  in 
classroom  manage- 

mjent___^  

Total  number  of 
CCLs 


Social  Interact  ion 


Variable  No. 
232 
233 

23^ 
235 


 Description 

Among  adul ts 'Social  Interaction 

Among  adults  and  children/Social 
interact  ion 

Among  children/Social  Interaction 

Between  observer  and  ch , : dren/Soc ial 
Interact  ion 


^ 


100  ^ 


N'umber  of  CCLs 
where  given  sub- 
jects are  engaged 
in  social  inter- 

ac  t  ion  

Total  number  of 
CCLs 


J 


j  *      ^^^^1  Materials  in  Ac  a  d  em  i  c  Ac  tivities 


Va  r_i  ab^[5_^^^L> . 
236 
237 

2  38 

239 


Description^ 


2A0 


2ii 


TV/ Academic  activities 


Audio  visual  equipment /Academic 
act  ivit les 

Lxpioratory  mater ia Is /Academic 
act  ivit  ies 

Math  or  science  equ ipment /Aca- 
demic ac  C  i vi  t  ies 

Texts,  wor  ^Dooks/Academic  activities 

Puzzles,  games/Academic  activities 

Percent  CCLs  in  whi(h  an  academic 
activity  is  oeeurring 


>  100  ^ 


N'umber  of  CCLs 
where  given  mace- 

r  i  a  1  was  _u seel  

Number  of  CCI.s 
where  at  least 
one  child  v;as  en- 
gaged in  an  aca- 
demic activity''* 


Number  of  CCLS 
where  at  least  one 
child  was  engaged 
in  an  academic 


100  '  ^^^^^^^^v 


Number  of  C^*'  S 


Academic  activities  include  activity  categories  6  throuj^h  9  on  the  CCL:  Numbers 
math,  irilhnrtic:  Reading;,  alph.:.hot,   language  development;  Social   Studies,  ^n-.)-'  ' 
graphv;    >'v.ience,  natural  world. 
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Ml  t*u  '"i»lli>\'  li.r.>tn.'h  Pr.'>:'ra-^  i]  issror^  '^hsc^rvai  ivui  fviluation  I^71-7J.  I'lu-v  art^ 
ia.'".ut'J  ti^i  ^  i'x  5.         *    'itiiviitv  past.  >-,tuJit^s  and   »or  tlu'  sa'r>'  vc[>iri- 


lU's^  r  ]  pt  I  on 

1  nrv  !  ,    -n-u      '  vaiui  tadin.i  i 

'  T"  IP  r  I'-x'  {  on>;  i  luJ  i  na  1 

'I  '  ,         i '  .   slap.v        /  5  oim  1 1  a  1  i  ua  I 

\r  t  >  ,  ^  Tvii  t  s  '  I  atiu  '  tad  ina  1 

(»'aessin^  ^ar, t'^s,   table  ganeh,  puzzltr^/ 
1 on^iCuJina! 

.\a  '  bt      ,   ra  t  fi »  a  r  i  llr.c  L      'I  on^  i  ludi iia  1 

Rt'iciing,  iiphabc't,  langua^f  devi/ lup^icnl  / 
I ong 1  Cud  J  na 1 

So'  ia]   siiidies,   ^»e^izr<inhvM.ong  i  tud  i  na  i 
ic:ut',  natural  ';or  Id Longi  tud  iiui  I 
i  ng ,  t  'ok  i  ng ,   pound  i      M  ong  i  Lud  i  nal 
Mo^ks  ,   t  riu  ks  '  koiu^i  Lud  i  na  ] 
Dri'^-Mitii    :)iay,  d  res^-uf>/ 1  ong  i  tad  ma  1 
\  I  i      r  ki^  '  f  s^-n^  I  Cud  I  Pa  I 

^'r  i  ti.  il   Sr.  ilN  <i.  au  1  >  i  t  :'>n/N>ngi  t  ad  in<j  I 


Vunbor  of  ('(is 
where  at  ItM^t 
f^ne  (  fi  i  hi   is  en- 
gaged  i  n  ac  t  1 V  i  - 
t  ies 

Total  numht-r  of 
(1 1  s 


'.ariabJe-^  .'37  t  ':^>>i^'i  Jlhl  mdi-  ite  the  average  frequence  per  (i  \  et  tlu- 
:r  'ari  p.i' : 


I'^iiii   .1   .  _ .       .  _ .  . . .  _ .  ^^M^iLy  ^  p}Jy}^^  _  _   

^-^^  E          '  1 1'^  f'Mt'  <  ill  Id,  a^acV'pi,    activities"  I  nigitaciip.al 

-  '  ,  1  K      :  I      'p»      ''iid,    i.  t  Iv:         ^  t  i  v  i  t  i  es'' M  tMig  i  t  ad  i  n<!  1 

-  *  '  ^  kitU  »  f- r     i  t  a  -  'nt   •     i  Ki  ,    i(  ad*--^       at  t  i  v  i  t  i  e^  /  I  ong  1 1 ud  i  ii,,  1 

'  ^  'iljria   i  n<,u  !H  n  it  .;t  ,   at.iOe.  ii    a*  t  i  v  i  t  i  v  "  ^  I  nng  i  t  ad  !  p.,i  I 

"1      i'^  f  '  •  1 1  i«-s  1 1  ad»'    i.  *.  i  ^  1 1  \  <  1 1  ev'     i  e    ^)  tlirt  ug[5  9  c>n  t  ii*    ^  M  : 
"  "  •       '  .    ,   •'    id  i    ,  ,    i  ]  p    > bf  f  ,    '  jt^Mi         d»-  • '  k'lv* .  n (  ;   ^ ia  1     f  list  ' '  ^ , 
:       ' '     •  ,  a  1 1  ar  H  '  ^lr  I  s . 

'  -IS 


•  hi 


ERIC 


For  Variable  260,   the  following  weighting  scheme  was  used: 

Hach  "one  child"  occurrpiice  is  weighted  by  1; 
Each  "two  children"  oicurrence  is  weighted  by  2; 
Hach  "small  group"  occurrence  is  weighted  by  5; 
Hach  "large  group"  occurrence  is  weighted  by  IQ. 


Variable  No> 
261 

262 


^  Description 


Any  adult  with  one  child,  any  activity/ 
I ongitudinal 

Average  number  of  adults  in  the  class- 
rooni/Longitudmal 


y    Averaged  over 
CCLs. 


In  Sections  4  and  5,  each  PRE  and  KMO  variable  name  corresponds  to  two 
variables:    one  based  or.  the  adult-focused  data  and  the  other  based  on  the  child- 
focused  data.    The  specification  of  one  of  these  variables  is  the  same  for  both 
sets  of  data,  but  the  focus  of  observation  may  make  the  interpretation  of  the 
meaning  of  the  variable  quite  different.    See  Appendix  D,  "Operational  Definitions 
of  the  Five-Minute  Observation  Codes,"  for  changes  in  the  operational  definitions 
between  the  two  types  of  observations. 


A .      Preamble  i?RE) 

a.      Focus  of  FMO 


Variable 

No . 

Adult"" 

Child* 

Focus 

Focus 

263a 

302c 

264a 

303c 

265a 

304  c 

2  6^'^  a 

305c 

267a 

306r 

268a 

307  c 

Description 


Teacher  focus 
Aide  focus 
Ch  i  Id  focus 

Group  size:    one  or  two  children 
Group  si?.e:    small  group 
Group  si;:e:     large  group 


Percent  of  FMOs  with  the 
given  person  as  focus  of 
observation. 


Percent  of  FMOs  where  rhe 
^    focus  person  is  in  a  group- 
ing of  the  given  size. 


"a'l  indicates  that  the  value  of  the  variable  is  based  on  adult-focus  observations, 
"r"  indirat^^G  that  the  value  of  the  variable  Is  ba.  ed  on  child-focus  observations. 
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h.       Adult  Role 


V  ir  Kih  le  No. 


Tok  us 

Voi  us 

lb9A 

308r 

I  e.u'ht^r  d  i  rvC  Ing 

27Ud 

)U9c 

ieacher  pariK  ipaling 

27la 

310c 

Teacher  observ ing 

27  2a 

3110 

Teacher  not  i nvo  1  veci 

2  7  )a 

312o 

Aide  d  i rc'i  i  i nu 

27-.a 

313c 

Aide  part  ic  ipat  ing 

27  3a 

3Uc 

Aide  observing 

276a 

315c 

Aide  not  involved 

Activit' 

/Genera] 

Desc  r  i  i)t  ion 


PerLent  of  I-MOs  where 
y      tiie  given  adult   is  in 
'       the  given  rc^le  at  the 
time  of  observation. 


The  specifications  of  the  following  variables  should  be  clear  from  the 
variable  name. 


Variable  _>k)_. 

Chi  fd''^^ 


Adult'" 
P\n'us 

277a 

278a 

279a 

280  } 

281  a 
282a 

2^3  i 

2H^a 


Focus 
316c 
3rc 
318c 
319c 

320c 
321c 

322( 

323. 


Descr ipt ion 


Average  nunber  of  frames  per  FMO 

Number  of  FM(Ks  with  lunch  or  snack  as  beginning  activity 

Number  of  FMOs  with  group  time  as  beginning  activity 

Number  of  FMOs  ivitli  story,  music  or  dancing  as  beginning 
ae  t  i V  i  tv 

Number  of  FMOs  with  arts  or  crafts  as  beginning  activity 

Number  of  FMOs  with  guessing  and  table  games  or  pu^'.^.les  a^ 
beginning  <ictivity 

Number  of  F>U)s  with  numbers,  math  or  <irithmetic  as  beginning 
ac  t iv  i  ty 

\urber  of  I  ^'ds  with  read  ing,  alphabet  or  langu<ige  deve  Icp- 
ment  as  beginning  activltv 


*'a"  inditaies  tiiat  the  value  of  tlie  variable  is  based  on  adult-focus  observations. 
'\  "  inJiiates  that  the  value  i^f  the  variable  is  based  on  child-focus  observations. 


Adult*  ""Child'"^ 

,?,ft^^"^.„      l9^±^  Description  

-^^^          ^-'**         Number  of  F>!i)s  with  social  studies  or  geography  beginning 
aotivitv 

28ba          325.'        Number  of  FMOs  with  science  or  natural  world  as  beginning 
ac t ivi  tv 


287a  326c 


Number  of  FMOs  with  sewing,  cooking  or  poui.ding  as  beginning 
ac t  iv  i  ty 


288a  327c        Number  of  FMOs  with  blocks  or  trucks  as  beginning  activity 

289a  328c        Number  of  FMOs  with  dramatic  play  or  dress-up  as  beginning 

activity 

290a  329c        Number  of  FMOs  with  active  play  as  beginning  activity 

29ia  330c        Number  of  FMOs  with  practical  skills  acquisition  as  beginning 

activity 

292a  331c        Number  of  FMOs  with  observation  as  beginning  activity 

(independent  children  only) 


/93a 

332c 

Number 

of 

FMOs 

with 

social  interaction  as  beginning  activity 

29^a 

333c 

Number 

of 

FMOs 

with 

unoccupied  child  as  beginning  activity 

295a 

334  c 

Number 

of 

l-'MOs 

With 

discipline  as  beginning  activity 

:96a 

335c 

Number 

of 

FMOs 

with 

transitional  activities  as  beginning 

297a 

336c 

Number 

of 

FMOs 

wi  th 

classroom  management  as  beginning  activity 

298a 

337c 

Number 

of 

FMOs 

with 

out  of  room  as  beginning  activity 

299a 

338c 

Nc  nber 

of 

FMOs 

with 

unknown  beginning  activity 

300a 

5  39c 

Number 

of 

FMOs 

which  begin  and  end  in  math 

301a 

340c 

Number 

of 

FMOs 

which 

begin  and  end  in  reading 

indicates  that  the  value  of  the  variable  is  based  on  adult-focus  observations 
"c"  indicates  that  the  value  of  the  variable  is  based  on  child-focus  observations 


3  .      M V e  Mi n iii u  j ) l^se_r vj-U  ion  ( F MO ) 

\d(\i  FMO  ^^irldble  is  dt^fined  bv  a  specified  set  of  frames''  or  sequence  of 
fr<inos  s.iid  to  ho  acvopt.ible.     I  ho  valuc"  of  an  FMO  variable  for  a  given  (^()P  is 
the  nuf bor  of  «iOLep table  frames,  or  frame  sequenLes,  that  were  observed.  The 
value  of  an  ^M()  variable  at  the  (.lassroom  level  is  the  average  across  all  CiWs 
with  the  indicated  focus  o\   observation.     .The  variable  spo'  if ications  that  fol- 
low list  eai^h  »'>!n  variable  along  with  a  description  of  the  frames  that  are  ac- 
ceptable.    Tie  acceptable  frames  are  dt.  st  ribed  by  lists  of  acceptable,  not 
acceptable,  and  necessary  ^ odes  for  each  segment  of  the  frame.     A  dash  under  anv 
segment  indicaie*=i  that  anv  code  is  acceptable. 

For  the  Ke2o_i_r ,  SimulraneQus  segment  the  codes  liswed  aie  those  that  are 
acceptable,     UnUss  stated  otherwise,  a  blank  (i.e.,  no  code)   is  also  acceptable. 

For  the  Who,  ]_o_  jChqi^    and  Wlui^  segments,  the  cod^s  that  are  listed  are  diose 
that  are  acceptable.     A  blank  (i.*^.,  no  code)  is  not  acceptable  ip  any  of  these 
segments . 

For  tr*^  Nonverbal  and  Motion  aad  How  segments,  the  codes  listed  either  must 
be  present  or  must  aot  be  present.     An  asterisk  following  a  code  indicates  that 
it  must  be  present.     A  "not"  preceding  a  list  of  codes  inuicates  that  none  the 
codes  listed  may  be  present.     Other  codej  not  listed  are  acceptable.    A  blank  is 
acceptable  unless  a  code  is  listed  with  an  asterisk, 

The  abbreviations  for  the  codes  used  in  the  specifications  are  as  follows: 


( I )    Repeat,  S  i  mu 1 1  a  ne  o  ^  s 

4 

R    =  Repeat 

S    =  Simultaneous 


(1)  Klio 

1  =  'I eac  her 
A    =  Aide 

V  =  Volunteer 

C  =  (  ill  Id 

)  =  Different  child 

2  =  ivo  childrer 
S  =  S'^.ail  group 
L  =  large  group 
Aa'  =  Animal 

M    =  Machine 


.3)  ;[p_>ll:l^i 

Same  as  Who 


See  ('hapter  II  for  a  description  of  how  the  FMO  is  filled  out  and  Appendix  I) 
.  oi   the  opvritUMial  definitions  of  the  codes  that  make  up  a  frame. 


(4)  v.'hac 


(3) 


(6) 


1 

X 

—  ^onniauu  or  icCjUt^bL 

J 

^  R  t*  p  o  n  b 

4 

5 

-  ik^neral  *.'oi*ipents »  ireneral  artion 

6 

-  lai>k  related  conrrents 

-  Acknowledge 

8 

"  Praise 

9 

=  Corrective  1  ec^dback 

10 

=  No  response 

11 

=  U'aitin^^ 

\2 

=  Observing,  listening 

.\onverbal  and  ^to  t  ion 

MV  =  Nonverbal 
X     =  Motion 


H  =  Happy 

r  =  Unhappy 

N  =  Negative 

1  -  Touch 

Q  =  Question 

Cj  -  (Juide/reason 

P  -  Pun  is £1 

0  =  (Object 

\-:  =  Worth 

D  =  Dr arna tic  p  1  a v / p r e t end 

A  =  Academic 

B  =  Behav  i  or 


1  a b  1  e  I )es c r  i_p^t  ion 

R,S  ;;ho  T     ^hoiT^  U^hat  NV,X   How 


lid  t(^  adult,  all  verbal 


T,A,V 


not  NV 


not  P  nor  0 


.1      Adult   to  ciiild,  ail  verbal 


C,D,2,S,L 


1,2.3, 
A, 5, 6, 
7.8,9 


not  NV 


not  0 


3A3a 


(hi  Id  lo  adult,  all  verbal  except  response 


(M),2,S,I       T,^\,V  I  ,2, A, 

3.6,7, 
8,9 

(;-2  3 


not  NT 


not  P  nor  0 


"1 


Variable  Leso r  ip t ion 


;o  ^«'h(nT^         What  NV,X 


How 


IndividiKil   k  h  I  Id  vtrbal  with  adult 


not  NV      not  0 


7,8,9 


OR: 


r,A,V 


1,2,3,  not  XV  Xoc  0 
7,8,9 


476c 


346a 
477c 


34  7a 
478c 


479c 


349a 
480^ 


350a 


351a 
4H^ 


352a 
483c 


Vorhal   in  tt>  race  I  oils  anu^ng  t^hiidren 

C,D,2,S,L      (:,D,2,S,L  1,2,3,       not  NV      not  0 

(neither  C  to  ('  nor  D  4,5,6, 

to  D)  7,8,9 

Child  commands,  requests,  and  direct  questions,  nonacademic 

C,D,2,S,L      T,A,V  1    not  G,P,0,A  nor  B 

C,D,2,S,L 

Child  cc^mmands,  reqtic»bts,  and  direct  questions,  academic 


C,D,2,S,L  T,A,V 

C,D,2,S,L 


1 


Child  open-ended  questions,  nonacademic 

_  C,D,2,S,L      T,A,V  2 

C,D,2,S,L 

Child  open-ended  questions,  academic 

C,D,2,S,L      T,A,V  2 
C,D,2,S,I 


Lhild  questions  to  adults 

R  C  ,  D ,  2  ,  S  ,  I        ^  A ,  V 


not  G,P,()  nor  B 


not  XV      not  G,F,0,A  nor  B 


not  XV  A''' 

not  G,P,0  nor  B 


not  G,P,0  nor  B 


Adult  'oni^ands,  requests,  and  direct  questions  to  groups*  of 
viiildren,  nonacadenu 


2,S,I 


1 


not  (;,P,0,A  nor  B 


*^ailt  (.onnands,  requests,  and  direct  questions  to  individual 
children,  nonacadenic 


T,A,V 


C,D 


1 


not  G,P,0,A  nor  B 


(  (^d*-  is  ne.  e->sirv  fi-r  tht    tran.e        be  atteptabh 

G-2'* 


ERLC 


So . 


35  3a 


3  3m  a 
A85c 


}3')a 


357a 
'*SSc 

358a 


15^a 
A90c 


360a 


3b  la 


36:.^ 

-4  9  3. 


V a_r_i ..U)_ I D e s o r  ipt  ion 

K,S  I'lH^ 


How 


\dull  cpinnands,  re(|aL'sc^,  and  direct  questions  to  group,^  of 
children,  a<  ad  en  i 


2,S  J 


A" 

not  C,\\0  nor  B 


Aiiulf  .or^rnand?>,  requests,  and  (Mrect  questions  to  individual 
t  h  i  Id  I  eti ,  academic 


r,A,V 


not  G,P,0  nor  B 


\dult  open-ended  qut-btions  to  children,  nonacademic 

T,A,V  C,D,2.S,L      2  not  NV      not  G,P,0,A  nor  H 


356a      Adult  open-ended  questions  to  children,  academic 


H 


T,A,V  C,D,2,S,L 


All  adult  questions  to  children 

R  '1,A,V  C,D,2,S,L  1,2 

All  vhild  responses 

C;,D,2,S,L      T,A,V,M  3 
(:,I),2,S,L 

C'ni Id  re^>Ponsei5,  ntMiacademic 

_  C,I),2,S,L      T,A,V,M  3 

C  D,2,S,L 

child  responses,  academic 

( ,D,2,S,L      T,A,V,M  3 
CM),2,S,I 


not  A'-' 

not  G,P,()  nor  B 


not  G,P,C)  nor  B 


not  P  nor  0 


not  P,0,A  nor  B 


not  P,0  nor  B 

cnlKi  responses  to  heh.avioral  (correction  or  re  mf  orcenent 


J),2,S,L  T,A,V 

C,I),2,S,1 


not  P,0  nor  A 


Individual  child  responds  tc  adult  academic  command,  request, 
i>r  d  i  re^  t  quest  ion 


R 


1,A,V 


1 


not  '  nor  i  ,i) 
8 


^()LLOWED  BY; 
T.A,V  3 


not  G,P,0,W  nor  B 


ot  (),(;, P,(i  nor  B 


ne.L--.cir     ti-r  ti\e  f raiae  to  be  a'.ieptaLle, 

(;-2  5 


ERIC 


Vjr. 

\_u .  V a_r  1  a b  i e  D e s o_r_l£^t  i  on 

5b 'ki  Child  group  re^pondb  to  adult  a^^ademit  command,  request, 

'♦04c  or  dire(C  question 

R  1,A,V  2,S,L  1    A'^ 

not  G,P,0,W  nor  B 

FOLLOWrn  BY: 

not  K  nor        J,:^.L  1  ,A,V  3    A'* 

S  not  P,(^  nor 

3bAa      Adult  response.^  to     ii  Id  requests  or  quebtions,  academic 

R  T,A,V  C,D,2,S,I        3  A'' 

not  P,0,  nor  H 

i65a      Adult  responses  to  child  requests  or  questions,  nonacademic 
496c 

R  T,A,V  C,D,2,S,L      3    not  P,0,A  nor  B 

366a      Adult  responds  to  child  question  with  open-ended  question 

^^^"^      R  (:,D,2,S,L      T,A,V  1,2    not  G,P,0  nor  B 

FOLLOWED  BY: 

not  R  nor        T,A,V  C,D,2,S,L      2  not  NV      not  G,P,(),IC  nor  B 

S 

367a      Adult  responds  to  child  question  with  direct  question 

^^^^      R  C,D,2,S,L      T,A,V  1,2    not  G,P,0,vv^  n.)r  B 

FOLLOWKD  BY: 

not  R  nor        T,A,V  C,D,2,S,L      1  not  NV      not  G,P,0,W  nor  B 

S 

36Sa      (Hiild  responds  to  adult  open-ended  question 

R  i,A,V  C,D,2,S,L      2  not  NV      not  P,O.W  nor  B 

foi.l(v,cf:i)  by  : 

not  R  nor        (,,i),2,S,L      T,A,V  3  not  0,G,P,0  nor  B 

S 

369a      Child  extended  response,  nonacademic 


500. 


not  R  nor        (,D,2,S,L      T,A,V  3  not  NV      not  P,(),A  nor  B 

S  C,D,2,S,L 

FOLLOWKD  BY: 

R  C,D,2,?,L      T,A,V  4,6  not  NV      not  Q,G,P,0,A 

C,r},2,S,L  nor  B 


^         is  netessarv  t'^r  the  frame  to  be  acceptable. 


G-26 


Var. 
No. 


37()a 
50  Ir 


371a 
502. 


372a 
30  3c 

37  3a 
30Ac 

'374a 
505.^ 


375a 
506t 

376a 
507. 

377a 
508c 


'.'hor  What  .\'V,a 


f^ow 


Cm  Id  extended  ^e^>pon^5*;• ,  acadt-mn 


not  K  nor  C,I),2,S,1 
S 


'1,A,V  3 
(  ,I),2,S,L 

FOLLOWrD  BY: 


not  N'V  A'' 


not  0,(;,P,o  nor  B 


(\D,2,S,L      'i,A,V  4,6 
(:,D,2,S,L 


not  NT  A' 


Child  extended  respcn->e  to  adult  open-ended  question 
U  i,A,V  (.,J,2,S,L      2  not  NV 


FOLLOWED  BY: 


not  R  nor  C,D,2,S,[  T,A,V 
S 


3 


R 


FOLiAHJKI)  BY: 
C,D,2,S,L      T,A,V  4,6 


diild  presenting  Information  to  a  group 
R  CD  2,S,L  4 

Adult   Instruction,  nonacademic 

T,A,V  C,I),2,S,L  4 

Aduit  instruction,  ae  adeinir 

T,A,V  r,I),2,S,L  4 

\dult  instructs  individual  child 

T,A,V  C,D  4 

Aduit   instructs  a  group 

T,A,V  2,SJ  4 

*hiid  se I inscruc t ion 

K  either  4 

C  C 
or 


not  0,G,P,0  nor  B 


not  0,G,P,0,W 
nor  B 


not  NV      not  0,G,P,0  nor  B 


not  NV      not  0,(,,p,0  nor  B 


not  0,G,P  nor  B 


not  0,G,P,A  nor  B 


NV* 


not  0,G,P  nor  B 


not  n,(;,p  nor  B 


not  n,G,P  nor  B 


not  T,0,(;,P,K,D 
nor  B 


D 


D 


378a 
509(. 


('hi  id  sel  f-ins true t ion ,  academic 


R 


e  ither 


or 


NV  A'^ 

not  T,0,(;,P,W,I) 
nor  B 


ode   1 ->  '.e-  e-^s.irv  t'jr  tt)e  {  rai  e   to  he  <U(t»ptahh> 


(;-27 


Var 


}79a 
510. 


'380a 


38  3a 


313c 


383a 


i8^3a 
317. 

3H7a 
318. 


i88a 
319e 


lo  VMc-  What  NV,X 


How 


(hiKl  St' 1  f  - 1  ns t  ruo  t  ion  ,  objLuLs 

R  eiciier  4  NV 

C  C 
or 

D  h 

Child  ,sel  f  -  Ins  Lnii  t  ion  ,  academe,  with  obje^.ls 

K  either  4  N^' 

C  C 
or 


I) 


I) 


(hi  Id   instriK-Cing  other  children 
R  C  D,2,S,L  4 

OR: 

R  D  C,2,S,L  4 

Child  tasK  persistence 

not  R  nor        C  C  4 

S 


not  T,f\(M>,i:,I) 
no  r  B 


not  T,(),(;,P,U',|) 
nor  B 


not  0,C,P  nor  B 
not  Q,G,P  nor  B 


not  T,0,G,P,W,I) 
nor  B 


Fallowed  by  Repeat  in  minimum  oi  five  successive  frames 
(value  of  1  will  be  given  for  each  set  of  five  Repeat  frames). 


Two  children  using  concrete  objects  tov.ether 

R  2  2  4  NV* 


Snail  group  using  concrete  objects  together 
R  S  S  4 


Social  interaction  among  children 

  C,D,2,S,[,  C,D,2,S,L 

(neither  C  to  C  nor 
D  to  D) 


(^hilfi  task- re  I  a  ted  comments  to  children 
_  C,l),2,S,L      C,D,2,S,L  6 

('hi  hi  general  comments  to  adults 

C,D,2,S,L      IwX^V  3 

(^hiia  task- related  comments  to  adults 
C,D,2,S,L      T,A,V  6 


0'*' 

not  Q,G,P  nor 


0* 

not  0,G,P  nor  B 


not  Q,G,P,0,A 
nor  B 


not  N'V      not  Q,G,P,0  m^r  B 


not  NV      not  Q,G,P,(),A 
nor  B 


not  NV      not  Q,G,P,0  nor  B 


Cvnle   IS  necessar>   ior  the  t  rame  to  be  acceptable. 

G-28 


Var. 
No . 


520.- 


390a 
52U 

39ia 


592  i 
52i. 


394a 
325o 

395a 
526^ 


39ba 
32  7c 


39  7a 
528c 


\ jiT i a D^ij<_J^^' k^r  ipt  iv>n 

r,A,V  (  ,I),2,S,L  5 

Adulc  ta.sk-rt  iatL'J  cunrenth  Lo  children 
'I,A,V  (\0,2,S,L  6 


not 


till  Id  aoknuw  iedgment 


T,A,V 


Child  rrai- 


C,I),2,S,L  T,A,V 

l.,D,2,S,L 


39  3a      Child  vorretiive  feedback 


C,D,2,S,L      T,A,V  9 
C  ,D,2,S,L 

All  adult  acknowledgnent  to  children 
R  T,A,"  C,I),2  S,L  7 

Adult  acknowledgnent  to  children,  academic 
R  T,A,V  C,D,.'  ; 


/Xdult  a.^knowifdgi^ent  to  child rei^,  behavior 
R  T,A,V  C,D,2,S,I-  7 


Adult  ackno'^;  U'devicn  t  to  children,  other  task-relatt  d 
R  T,A,V  C,D,2,SJ,  7 


not  o,(;,p,(),A 
nor  V, 


not  NV      not  Q,C,P,()  nor  P. 


not  N,n,(.,F  nnr 


not  l',N,0,(;,P,( 
nor  U 


not  P,()  nor  W 


not  N',0,C,P  nor  0 


not  N,(>,(;.P,0,l.\l) 
nor  B 


not  N,(^C,P,0,UM; 
nor  A 


not  N,(),G,P,<),V;,A 
nor  B 


398a 
329c 

399  ji 
3  30l 


All  adult  ptaise  to  ctiildren 

R  I ,A,V  C,D,2,S,L  7 

Adult  reinforcement  with  tok^^n,  academic 
R  T,A,V  C,D,2,S,L  8 


not  N,0,G,i^  nor  W 


0*,A'^ 

not  U,N\n,G,P,vvM) 
nor  B 


IS  ne'e->-irv  tur  liu-  i  ran^.^   to  ai-ojptabl^' 


<-29 


ERIC 


war. 


'  dj  i.iblo  Desor  ipt  u> 


.n  it 


Vox- 


^^^^       ^  ^\,V  (\I),^,S,I  8 


not  I  ,N,(),(.,P,U\1) 
no  r  A 


Aula  AJuit  reint  ur*.-enont  with  token,  other  tabk-relaCed 
^3Jr       <  1,A,V  C,D,2,S,I  8 


not  r,N\(),(:,P,W,A 
no  r  H 


-♦UJ  i  Adult  praise,  acddcr. 
''''        H  I,A,V 


C,D,2,S,I  8 


not  1%X,()J,,P,W,I) 
nor  H 


A0  5i      Aduit  praise,  behavior 


C,D,2,S,L  8 


not  r,::,o,'  ,p,i.',i> 

no  r  A 


AOAa      Ad'jit  praise,  oth^r  tasu-related 

K  r,A,V  C,D,2,S,L  8 


not  l',><,0,G,i^,U',A 
nor  H 


-*ODa  All  adult  v"orre<.tive  feedback  to  children 
'^^^^       R  T,A,V  (\D,2,S,L  9 


not  <^  nor  W 


A06a      Adult  Positive  corrective  feedback,  acidenic 
S  1,A,V  (:,D,2,S,L  9 


or  0)'\A'* 

not  r,\',p,o,r J) 

nor  B 


*n^a       Adolt  n*'>zal  iv-  ^t^rrtstive  feedback,  acadenic 
H  I  ,A,V  (:,D,2,S,L 


or  I>)^\a" 

not  H,o,(;,(\'.;,i) 

nor  B 


-'J'^-a       'dult  positive  lorrective  feedback,  behavior 
P  1  ,A,V  (  ,I),2,S,L  9 


(G  or  Q)*,B* 
not  li,N\P,(),;% 
nor  A 


AJuIt  ni'v^ative  Lorret  live  feedback,  behavior 
^         i<  i,A,V  C\D,2,S,I  9 


04  or  P)*,B'' 
not  H, <)»(;, n,i:,D 
nor  A 


^--^kIo  i«  ne.  t^'^r^arv  fi-r  the   i  rame  Ic-  b^*  atctptabh 

(  50 


.  ar  . 


-♦10a 

5:.K 


Jl*."^     .        ^..'v'>\  _lMji^l<T,  N'V,X  How 

Avlult  positive  torreitivc  !\'edback,  other  task-rclateu 


K 


:\A,v  fM),2,s,i 


not  r,.\',P,(),':,\ 
nor  B 


Aviui:  negative  corrective  feedback,  other  task-related 

'^^  KA,V  (  ,D,..>,S,L      9  _  C\  or  P)'^ 

not  H,(),(;,(),v;,D,A 
nor  B 

\duiL  it-edbacK  for  child  response  to  adult  academic  command, 
request,  or  direct  question 


T,A,V 


C,D,2,S,L  1 

FOLLOU'P:o  BY: 


net  K  nor        ^,D,2,S,I       1 ,A,V 


not  R  nor  T,A,V 


FOLLOWED  BY: 
C,D,2,S,L      7,8,9  _ 


5'*  3v^ 


nUld  not  re'iyponding  to  adults 
r,D,2,S,L  1,A,V 


10 


Adult  not  responding  to  child 

1  ,A,V  C,I),2,S,I  10 

A 11  i  •»  I  Id  reu  v;a  1 1  i ng 
R 


ti  ther 

c 

or 

C 

or 

I) 

or 

2 

or 

S 

L 

L 

^  I  'a 


^  ilJren  at  tent  I  vt'  to  adults,  nonacaderiic 
^',^,2,?,L      T,A,V  12 

riUren  attentive  to  adults,  acaderi^ 
C,D,2,S,L      T,A,V  12 


ne  e^^ar,'  ^.t  t'."  Tr  ^-e  to  be  arcei;tablc, 

31 


not  C,P,()  nor  B 


A"" 

not  0,G,P,0  nor  B 


not  V  nor  B 


not  Q,G,P,0,lv,D,A 
nor  B 


not  0,(:,P,(),U\I) 
nor  B 


ERLC 


V.iri  ihjt'  ^K'^.  '^'Jjl.Lb'" 


lo  \:hor  ,.'hat  '.T,X 


How 


\vlult<^  attt'otivc        children,  nonacaciuinic 
I,A,V  (  ,]),2,h,l  12 


not  (),G,P,(),W,I),A 
nor  B 


^i9A      ViuUs  attentive  to  ^nildren,  av'adenic 
1,A,V  (,I),2,S,L  12 


not  0,G,P,(),W,I) 
nor  B 


-♦2*)  1      Adulcs  attentive  to  stnall  group 

i,A,V  S  12 


not  (),G,P,0,W,I) 
nor  H 


•^2la      Adults  attentive  to  individual  child 


12 


not  0,G,P,(),W,I) 
nor  H 


^22a      Positive  behavior  anong  children 

C,D,2,S,L  C,D,2,S,L 


'•+2 3a  Positive  behavior — adults  to  children 
55-^0 


I,A,V  C,D,2,S,I, 


not  U,N  nor  P 


not  r,\\  nor  P 


f.^sic:ve  be'navi(>r,  children  to  adults 
(,D,2,S,L  T,A,V 


A25  t      Child  expressions  of  unhap:)iness 
C,D,J,S,I 


^2hd      Xdult  expressionb  of  unhappiness 

537' 


T,A,V 


not  nor  }* 


not  M,P,  nor  l\ 


not  H  nor 


:*i^iCl"e   hehavitr  aHong  children 

(  ,:),2,s,h  r,i),2,s,i 


.Jb  i  '.ej^itr^'e  hf'.ivior,  adults  to  'children 
;3Vi 

i  ,A,V  (:,D,2,S,L 


(l-^  i  .  nt^t  essrirv  for  the  fra"ie  to  be  <icceptable. 


not  H,(^,(.  nor  W 


not  H,0,(,,()  nor  V, 


ERiC 


Vjr. 
No. 


560.' 


A  30a 
56  K 


A  Ha 
562o 

•;32a 

A  Ha 
56A<> 


Variable  ^^t-^- rxj^t^xon 


Ui.  m\  What  XV, K 


Negative  behavior,  children  to  aduUs 
(  ,I),.\S,L  T,A,V 

lot  i\    idu  It  af  f e^  t 

Total  child  aftee" 

Ad  a  1 1  pu  n  i  s  hine  n  t  of    h  1 1  d  r  e  n 

R  T,A,V  C,D,2,S,L  9 

Child  statements  ot  self-worth 


{low 


C,D,2,S,L  1,A,V 

C,I),2,S,L      A, 5, 6, 
7,8,9 


not  H,(>,(,,(^  nor  i; 


(H,r  or  N)'' 
not  0 


(H,r  or  N)''' 


not  H,Q,G,0,W 
nor  0 


1,2,3,      not  NV  W 


not  U,N,P  nor  o 


A  34  a 
5b  5o 


DranatK    pla\  ,  pretending 


A35a 
366c 


A37a 
568c 


T,A,V  T,A,V 
C,D,2,S,L  C,D,2,S,L 


Total  a  ad en ic  verbal  interactions 


1,2,3, 
4,5,6, 
7,8,9, 
10,12 


3,7,8 


T,"  ,V  T,A,V 
(:,D,2,S,  C,D,2,S, 

lotal    interactions,  beli.wior  control 

_  T,A,V  T  A,V 

t,D,2,S,L      0,:\2,S,L  9 

Children  engaged  in  nutiial  activity 

. _  either  A, 5, 6 

>  2 
or 

S  S 


A'' 

not  B 


not  0,W  nor  A 


not  0,G,P,W  nor  B 


4  38,, 

56'^^ 


Adult  com:'Hinicat  i  on/attention  focus:     one  child 


R 


T,A,V 


C,D 


1  3 
A, 5, 6, 
7, 8, 'J, 
11,12 


ul'.  es->ar\   t  JY  tfie  t  rar«e  to  be  acceptabi 


not  o 
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Var. 


^39a 
S70o 


37h 


la 

^7 


573c 


J<,  ^     ^  '  'ho   To  1.1 1  on 

Adult  coninun  1  cat  1  on/at  tent  ion  tocu^: 
K  I,A,V  2 


Adult  ooinimin  u  at  xon/at  tent  ion  fo(^us: 
R  T,A,V  S 


Avlult  communication/attention  focus: 
R  T,A,V  L 


All  child  nonverbal 

c,n,2,s,i. 


•^^  3a 
5  7-4c 


_  C,D,2,S,L 

Child  iTiOvenenl 

C,D,2,S,L 


OR: 


^.:ha ' 


two  *.!iildrt'n 

I,  2,3 
A,5,b, 
7,8,9 
il,12 

sma 1 1  group 

^,5,6. 
7,8,9, 

II,  12 

large  group 

I,  2,3,   

^,5,6, 
7,8,9, 

II,  12 


1,2,3, 
7,8,9 


10,11 
12 


1,2,3, 
^,5,6, 
7,8,9, 
12 


!lov 


not  0 


not  o 


not  0 


not  V 


not  0,C,P,0,U',D 
nor  B 


4^>+a 
573c 


Adult  -^ovepent 


r,A,v 


1,2,3, 
^,5.6, 
7,8,9, 
12 


57bc 


\dulc  leaving  rooir. 

ei  ther 
or 
or 


T 
A 


not  T,0,G,P,O,U\ 
D,A  nor  H 


roll  owed  by  "Cancel"  in  nex:  one  to  five  frames. 


rode  is  necessarv  for  the  frame  co  be  acceptable. 


0-34 


Var. 


io  Ulu^p  t  N'V ,  X  How 


_  C\D,2,^J       M  1,2,3,      not  XV      nut  T,(;,P,(),i; 

A  ,  5 ,6 ,  nor  B 

7,8,9, 

12 

OK: 

  M  C,I),2,S,L      1,2,3,      not  NT      not  1\(;,P,(),K 

A , 5 ,6  nor  B 

7,8,9, 

12 

w7a      Aciult  neutral  corrective  feedback,  otiier  rabk-related 

H  T,A,V  r,l),2,S,L      9    not  N' ,0 ,  P ,  O  ,K\  A 

nor  B 

A-48a      Adult  neutral  corrective  fetrdback,  behavior 
579 

K  T,A,V  C,D,2,S,L      9  H'' 

not  ,P,n,i; 
nor  A 

AA9a      Adult  neutral  (.orrettive  feedback,  academic 

^^^^"^      R  ,  T,A,V  r,i),2,?,L      9    A'- 

nor  X,(i,v;,P,n// 
nor  B 


Iht;  follou  variables  are  sums  of  previoubly  specified  FMO  variables,  Ftie  nup- 
ht.'r-^   m  p  [  tMitru  ses  rt-'fer  to  the  variable  as  nunbeied  for  adu  H  foeus  fbst^rval  icn^ 


Vir. 

No  .  i) e  s  ^  r_i  p  I  i  o n 

R,S  i;ho  Io  K'hom         What        NV,X  Hqw 


^30a      All  thild  open-ended  questions  (348a  +  3A9a) 

38 1  < 

  C,i),J,S,L      T,A,V  2  not  not  C,P,()  nor  B 

(^,0,2,^,1^ 

-5!a       Vd'ilt  a*,  a  Jsi^'Di  t     or:'^  inds  ^re<|uests  and  direct  questions  to  children 
58  (  T)  ia  +  3 )  '*a) 

K  r,A,V  C,D,2,S,L       1  A'' 

not  (^P,0  nor  H 


^'ode   IS  nei  e>^^sar^  \  nr  the  frame  to  be  acceptable. 
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Var. 


\:h.->n         What  \V,X  How 


43ia      AM  adult  opt-n-enJed  <juestion^  to  children  (335a  +  ^56a) 

R  1,A,V  (\b,2,S,L      2  not  NV      not  C,P,()nor  H 

*'-*^)]a      \du\*-  rc^sponse  to  cb. ildS  question  with  a  question  (  366a  +  367a) 

R  {\D,.,^,L       i^A,V        '     1,2  _  not  (i ,  P  ,0 ,  W  nor  B 

Not  R  nor        1,A,V  (Ms2,S,i       1,2  not  NV      not  G,I>,(),K  nor  B 

s 

-o^  *      c'lnld'b  extended  response*  ('369a  +  370a  +  37ij) 

R  C,D,?.,S,i       r,A,V  3  not  NV      not  P,0  nor  H 

C,D,2,S,L 

KOLLOWKD  HV: 

R  C,D,2,S,L      T,A,V  /i,6  not  NV      not  0,G,P,0  nor 

C,D,2,S,L 

455a      Ail  adult  insttuction  (373a  +  374a) 

^^^"^  T.'^V  C,D,2,S,i,      4    not  0,(J,P  nor  B 

456a      Ail  o'  ii:  task-relaced  comments  (386a  -f  388a) 

C,D,2,S,L      1,A,V  6  not  NT      not  0,G,P,()  nor  B 

C,D,2,S,1 

4'^7a      All  adult  positive  corrective  feedback  (406a  +  ^083  4-  410a) 

^''"^"^      R  T,A,V  C,D,2,S,L      9    (C  or  0)'"' 

not  U,N,P,0  nor  V 

,58a      Ml  adult  negative  corrective  feedback  (407a  +  409a  +  411a) 

^^"^'^      R  r,A,.  C,n,2,S,I       9  (N  or  P)'^ 

not  r,X,P,0  nor  W 

439a       Ml  adult  praise  for  acader.lc  responses 
'90v 

(I)upluate  of  Var.  402c./M4c  ^ 
460a      All  tfMld  po^liiv-  affecL  (422a  -f  424a) 

^"^^^        _  C,D,2,S,L      T,A,V  _  \r 

C,I),2,S,L  not  U,N  nor  P 

461a      All  Muld  negative  dffect   (427a  +  429o) 

-'^^-^'^  ,  r,lJ,2,S,L      T,A,V  _  .V 

(:,D,2,S,L  not  ll,(>,f;  nor  W 


Code  is  ne' ess.irv  fur  th*.    frame  to  be  a'^'eptahle* 


G-  J6 


\  .1  r  I  ah  1 Dy  sj,  jr_ip_t  ion 


;'ho^.  f'^^^^' 


^^Ja      All  positive  bt.-hdv?  or  ('*12d  4-  +  A  24a) 

^'^^^  . 

I,A»V  'i,A,V  _  \r 

i  ,I),:,S J         ,D,2,S,I        '  "  not  I  ,\  nor  P 

4b3a      Ml  T^r'^aiivt'  behavior  (4j7a  +  AJ8a  +  AiVa) 

I  I  ,A,v  _  _ 

(.,i)»J,S,I       i',I),2,S,I  '  "  nut  n,()A'  nor  V 

-tO  K.      cr>ild  att^^'utive  to  adults  jr  machine  (Alba  +  Ai7a  +  A^^iba) 

r,A,V  12  _  not  0,G,P,(\U',n 

nor  B 

OK: 

<-»l),2,S,L      M  1,2,3,      not  N\'      not  r,G,P,0,K 

4,5,6,  nor  B 

7,8,9, 
12 

OR: 

M  C,I),;,S,L      1,2,3,      not  NV      not  T,G,P,v),W 

4,5,6,  nor  B 

7,8,9, 

12 

^63a      2\diilt  tec*aback  to  rhildren  fo**  behavior  (  396a  f-  '*()3a  +  408a  +  409a) 
R  r,A,V  C,D,2,S,L      7,8,9         _  B^^ 

ChiLi  St  1  f-e.-teen^  (392a  +  393a  +  433a  -f  434a) 

39'/ c 

a)    C,D,2,S,L      T,A,V  8,9  not  P,0  nor  K 

C,D,2,S,L 

OR: 

h)    G,I),2,S,L      T,A,V  1,2,3  notNV 

C,D,2,S,L      4.5,6,  not   L\:,\P  nor  o 

7,8,9 

OR: 

O      ^  C,D,2,S,I       T,A,V  3  not  NT      not  P,0  nor  B 

( ,D,2,S,L 

0\<KI)  BY: 

<  ,n,2,S,I       T,A,V  4,6  not  NT      not  0,(:,P,Onor  B 


'\le  is  ne.  e^s<irv  for  thtr  frame  to  be  acceptable, 

G-i7 
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I 


'^o.        '  ariabj_c  "'f-^.  run  u  n 

OH : 

I>  1  not  i> 

OR: 

b)  k,l\J,^.,!       (  J),^,S,I       b  nut  \V       \ol  P,(i  ium 

»  I'llit.T  ->»5,b  not  0,(;,l\i;  nor  !' 

or 


'ib^  \      \bi\d  Self   indriioti^n,  nonacader^  i  c   (377a  -  378a) 

R  either  NV"'  not  I  ,^^(; ,  P  ,tM) ,  A 

C  nor  P> 

o  r 


.b^^i      All  adult  r.MnNT.  e'c-nt     iih  l.ik.^ns   n^9a  4-  \{){)a  AOia) 

not  /  ,\\n,(  ,p 
nor  ^' 

-wOa       Ml  adalL  'leutril  .  t-rr^^t  c  i  vt^  t  et- dba.  k  (;^7ci  +  A^VHa  A'+^^a) 

I,A,V  C,I),J,S,L      ^  not  \',o,(.,l\M 

nor  K 

'♦7la      AduIl->    ittt>ntive  to  lar^^e  group  <''^18a  +  -W9a  -   +20a  -  Aila) 

r^A.V  1,2"  12  _  not  n,G,pj),rj) 

nor  H 


'  o'ii/  I     ntLessar\   '^'.'r  tlie  fia^t-  t-'  bf  jict'D  table. 

"i'v^-  '  nildren"  is  i  ni  1  ided  Ker^  bt'^  .lust^  Lbf  varijbN'  \ms  addt^d  att«*r  t  *i>r- 
puit-r  run  ^-as  (ornletei;  huuvvc-r,  it  felt  that  the  rrt'quein  v  of  ad\iUs  at- 
tnntivt'  to  i\ 'J  thildr^'H  will  be  niniT,^!  and  will  not  .i'  grejtly  t  iie 

t  n-'jut'-v  ^  of  thi'  intt'udt'd  vjriablv. 


Appendix  ii 


AXAiA'SIS  SPIXIFICATIONS  FOR  TilK  TKACHER 
AND  TEACHING  AIDE  QUESTIONNAIRES 


\ppt  ikI  i  N  l\ 


WAIVSIS  Sf'LCIFICAriONS  FOR  THE  I'EACfiKR 
AM)  ILAnilN'C,  AIDE  QL'KSllONXAIRI' S 


^  •       reachcr  i|Li o s Ijiou n a  i r e 

Ihc  .oinputations  wtTc  porforned  for  each  site  and  for  each  sponsor.  The 
unic  of  anaUsii,  was  the  teacher.     Non-Follow  Through  teachers  were  onutLed  from 
the  i^omputat  ions  .  r  ^ite  and  ^sponsor  statistics.     The  means  and  standard  devia- 
tions for  N'on-iollow  Tiirough  teachers  were  computed  separately. 

AKo  rei^orded  were  the  number  of  teachers  included  in  each  computation  (i.e., 
for  Follow  Through,  the  number  ol  Follow  Through  teachers  at  eacn  site  and  over 
sites  within  sponsor;   for  N'on-FoUow  Through  the  total  number  of  Non-Follow  Througii 
tea^^hers)  and  the  r.an.ber  of  teachers  for  whom  the  Questionnaire  is  not  available. 


*      'TeacI ie_r  J> a  t  i  s f  ac  t  ion 

Reverse  order  of  valu-.-  for  questions  11,  12,  13,  34,  71.     Aad  the  values 
of  questions  11,  12,   13,  34,   71.     Report  the  mean  and  standard  deviation. 


Quest  ijjns 
(11) 


If  you  had  your  choice,  would  vou  teach  in  Follow  Through  next  year? 
(ChiXK  ON'E) 


1 )  Def  i  ni  tely  yes 

2)  Probably  yes 

3)  Undecided 

4)  Probably  no 
3)  Definitely  no 

b)  I  am  not  familiar  vith  Follow  Through 


—Skip  to  Question  14 


(12) 


Recognising  that  the  parent  must  make  the  final  decision,   if  a  parent 
asked  your  opinion  would  vou  advise  her  to  enroll  her  ciiild   ir^.  ^  ''o]  low 
Through  class? 


1 )  Def 1 n 1 tely  ves 

J)  Probably  ve-> 

3 )  1  nde(^  ided 

4)  Probably  no 
3)  Definitely  no 


(13) 


If  a  friend  asked  vour  opinion,  woulci  you  advi-e  her  to  teach  in  a 
I-oilovv;  Ihrough  viass? 


1)  Def  initeU  ves 

2)  Probablv  yes 
3;  Undecided 

4)  Probablv  no 

3)  Detinitelv  no 


H-  3 


(5^;    Iriinivin^^         l         <  hiss  as  a  wluiU-,   huw  .sa  Li  si  led  are  vou  •  ith  t  tie  o\'k\- 


ERIC 


!  )       er  /  sat  i  -^J  u  d 
J  )     Sal  i  bl"  U'd 
n     Mi xed  t  f  e  1  i  n>;^ 
iM  ssal  I  .sr  1 1  J 
)      Ver  \    d  i  b-^ai  1  st  I  ed 


(71)   Ir   voi]  had  your  dio  u  e  o\  a  'v'a\  to  tea^h,  would  you: 

i)     Toni  in'i<-'  lo  iKse  the  sponsor  \s  approavh  you  are  usjng        (  ) 
t  o  t  he  -^apie  e\t  en  L   vou  do  no\' 

.M     Alter  vour  leaolung  some,  but  continue  to  use  the  (  ) 

approach 

Isc  sorie  of  tiuK  approach  m  vour  teaching  but  change  (  ) 
riost  ot  it 

-*)     Nv)t  use  this  approach  at  all  (  ) 


b  .       F r t^'ji^ue n^  V  _ajivi  K_i  nd        'I .  a  i  n  i ng 

Di-  not  su:^.     Report  separately  for  each  iteni  a-h   (onit   i)  on  ques- 


tion J-'* 


(1)     A  tallv  of  t:u'  "never"  (value  cf  i)  responses 


'lean  and  s tarJard  dev  i a 1 1  on  for  those  responses  other 
tiian  never,  reseaied  as  follows: 


K e^sj20i'is^e  K e s t  a  1  e  Ik 

2,  2 
3  5 
A  9 

5  ^2 

6  36 


Out  ^t 1  on 


(2'*)  Below  are  several   types  of  pre-  or   in-service  traiaing  vou  mav  have 

ro.  eivij  t  ror    .  ur  tea^  tiing  ass  ignm^'nt  this  school  year.     Indicate  holou 
p.mu  often  this  vear  vou  received  ed<.  h  of    Jie  following  types  of  t/air- 
i  ng  .     I  st   this  sc  ale: 

'  =  Never 

2  =  About  on{_e  or  twi-^e  a  year 

i  =  About  every  other  month 

-*  ~  AbvJUt  once  a  r^ontli 

>  About  2  to  3  tim^s  a  month 

f>  ^  About  once  <i  week  oi*  .iv>re 


^Vit^t  1  iN    si  I  K  u  to  SkHir  lor     oar  o\m  u^c*. 

Visits  or  de"  v^nstrat  loa^  in  vour  own  t  lj->srowri.  Q] 
L  tit; i  r  ^  la ^  ^rooi:^^> . 

Workshops  .iuimg  Vci^itioii  period-..  Q 

Uork^iiopN    in  b.iturda\s        alter  sui  ol  .  [J 

I  on  1  t.it  1  on^  v.'iifi  spvoia  lists  or  ir  Mru-rb^  not  Q 
in  vour  own  *  lassro^>n. 

\  uiooi  tpos  oi  rodol  .o<uhing  t'pisodt:>.  [^J 
\  iJ«  otapL's  yourself  in  teaciiing  epi.^odes.  Q 
Otht-r  (SPICIFY) 


Ira  i  n  i       hrr  pjui i  s 

Ito'  .  a  I'-'riHi^ti  p  —  I)o  not   ^uri .     Report  tne  LalHe^  ior  ea  1>  itcn  in 
qin^t  ion  23  separate!  V. 

(J'l)   Bt  h)W  are  -e\eral  areas  in  whi  L  you  may  have  received  pre-  or  in-st-rvue 
training  lot   \our  leaching  as.:>ignmenL  thi.-,  SLhool  V'^ar.     indic<ae  how 
niu  h  enptiasxs  was  phued  on  eaLh  ot  rhe  copies  listed.    Tse  the  following 
sea  le  : 

1  =     A  great  deal 

2  =  Seine 

3  -  ^lone 

a.  He*Ding  tlie  child  leel    inportanL  as  a  person.  Q) 

b.  Devt-^iup mg  en* 'Hi  ■> lasin  for  learning. 

Developing  basio  skills  such,  as  reading,  uriting 
.ind  "Vith. 

.       Developing  probKm  solving  and  critieai   tninking.  fj 

Developing  the  ehiid's  ability  to  work  and  piay  £j 
cooperatively  with  other  children. 

f  .       Helping  IUl^  <hild  to  nake  c'-ioitts    znd  be<  v^e  <u.  Q 
1  lulenen^Jen  t   U  <irner  . 

fi .       Involving  parents  m  tiieir  oldld's  learning  [_J 
ic  t  ivi  t  ies  . 

Involving  parents   mi  the  i)pe rat  ions  of  tne  s.  ',ool  .  Q 

i.       iMagnosing   individual   learning  needs.  *  Q 

'n       '  ii  :ia^-  .I'lldre?!   m  learning  activities  appropriate  [_J 
t-'  tlieir  nocds. 

k.       '  Ol      r  it  un;  efie'tivelv  wit;,  other  adu'i      'n  t  lu  Q 
j  i-'-rov)r  . 

1.  rk.ng  uitii  siiall  gr«<tips  of  .'niUiren.  QJ 

r.       \rritu,ing  f  i.v-  i!a<,srou{)!  etA'irounent  for  mstru'ti  >n  f"J 
(;)ii.tr.tni     f  'jrniturt,  inat,eria.s,  -'(lu  pincnt,  etc.). 
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'•••i  tuning  disoipline  and  tontroi  in  the  ^labsrooin.  Q 
<«.  L'sing  rew<ird?>  to  influence^  pupil  behavior.  Q 
P.       ih'\'cU)vin^  And        ->».*K'.  t  mg  -atcrij].->  t^.  suit  Q 


d  .       C  I  a  -> s_r oon  J^<-' r  i jn  i  tn\- -J     >.  i  b  1^/  S  t_r  u^'  t  u  r  ed 

Qiu'sLion  jJ  (.-irit  itt-rs  e  dn<<  i).     Reverse  order  ol"  value  tor  question 
3J,   iten^  a,  d,   I,    i,    j,  k,  not  reverse  b,  c,  g,  or  h,)     Report  tiie  mean 

ind  stand<ird  deviaiLon  ot    tiie  sum  of  the  responses. 

(32)  Classrooms  differ  in  many  wavs  depending  upon  rhe  philosophy  and  goals 
of  the  teaching  staff,  neeus  of  children,  etc.     Lach  statement  in  Col- 
umn A  is  matched  with  a  contrasting  statement  in  Column  B.     For  each 
t>air,  place  an  X  inside  the  parenthesis  v/hlch  comes  closest  to  describ- 
ing vo u r  own  class rv>or. . 


i  ol  UHtP  A 


Children  work 
I  Pde pendent  1 \ 

1  ea^  her  i.'n- 
parts  inN>r- 
•^Mtion  and 
prov  ides 
dor  nstra- 
t  ions 

Adults  ini- 
tial inivr- 
a<  tions  with 
t  h 1 Idren 

hnphasis  on 
e'n(U  lona  1 
needi. 

I'nde-^  I  red 
beh.iiv  1  or 
is  '-.'r- 
r  e.  t  ed 

at  t  I V  I  (  X  e  ^ 
it  t.i' 


Almost 
always 
1  ikL>  A 


(     I)  \  i  >) 
(  ^) 


i     1  ) 


(  1) 


(     1  > 


i  > 


(  2) 


^  2) 


Somewhat 
1  ike  A  and 
bomev;hat 
like  h 

(  3) 
(  O 


(  3) 


(  3) 


(  3) 


3) 


0 


(  A) 
(  4) 


(  4) 


(  4) 


^  4) 


(  4) 


(  4) 


(  4; 


Almo5-^t 
a Iways 
like  B 

(  S) 
(  5) 


(  3) 


(  3] 


(  3) 


(  5) 


(  3) 


(  3) 


Col umn  B 


Children  work  under 
adui  t  superv  is  i<Hi 

Children  gather  in- 
formation on  Iheir 
own 


<'*hi Idren  iniii^ite 
interactions  with 
adults 

Lmphasis  on  subject 
matter 

I'ndesired  behavior 
is  ignored 


Al  1  the  class  is 
engaged  in  the  sare 
ac  t  ivi  t> 


Lessor 
ible 


plan  is  flex- 


Work  and  plav  <ire 
not  d  ist  ingu  ished 


\:\\    iK  r  I V  i  - 

tir:* 

r.i  tcr  I  i  N 
liKi  I V .  \ 

(  h 1  lure n 

^^r  i  I       a  no 

givrn  f.'f 
spe'  if  I. 

1  i  Jreii 
pla.  ^..s 


(     1  ; 


<  1) 


(  3) 


(  -0 


(  3) 


(  A) 


alua.. 
i  i  Kt-  B 

(  5) 


5) 


(  3) 


{  5) 


(  3) 


K*    h  i  ng  -^t  a!  - 
Ccrnints  a^  t  ivi  t  il-- 
auJ  i:uil».'r  la  1  s 


nant 

Chiidren  do  not  in- 
teract f  ro-o  i  V  \:i  t  h 
uach  othf  L* 

Praise  and  approval 
given  without  re- 
gard to  spec  i  f  ii. 
ac  compl  ishi^ents 


Children  bavt-  as- 
signed seats 


I  ^t :  m u  _i_t  v_  of_  ^  \  e  a  i  ti  e  r    ()uc-^  t  ion  5  ^rl 

rall%   the  nurber  of  ea.  ii  ethnic    background.     Use  tlie  total  number  for 
I     :  1 1'    -n  1 1 1'"^  .  -'S  . 


(38)  Art-  .^Vi 


>,er  1^  an  Ind  i  an 
,\<^gro  k 
Or  I  enta 1 

S'^in  1  sh  surnare  : 


f  aut  is  lan  'whi  te 
other    rspl  r  n^Y) 


All  an  Anerlcan 
PiK^r to  Rir-an 
Otner  Spanish  ^peaking 


r  'i'Jo^M'U^  J'S  r*'p  'ft  t!'e  iruan  and  standard  devialivMi.  for  'jfn  -^t  ion 
.r,r  ta!li<,'^.     <onbin»'  t^t    t-Wlu's  for  response  values  1  and  }, 


Olk's t  ions 


(10)  Do  you  nave  ar.v  .iiildrun  in  Lhii>  da^s  iron  homes  in  which  anotiu-i 
1  in^w  ige        u-^ivi  nurt-  often  lhan  ingii^li? 

I)     Yes  {     )     How  many'^QJ.  ^ 

N'o  i  >— *-Skip  to  (^'itsiion  1> 

3)     Don't  know       {     ) — ^Skip  to  Question  11 

(11)  Aho  of  tiie  teaUiing  staff  speaKb  th-i  home  language  of  these  cluidren^ 

I)     I  do,  and  so  does  at   least   jne  other  staff  member  (  ) 

\n  this  class. 

1)     I  do,  bi<c  no  other  staff  meni.-^r  in  this  class  does.  (  ) 

3)     I  do  not,  but  at  least  one  othe-  staff  member  in  (  ) 

th is  c lass  does . 

)     :<o  meniber  of  the  teaching  staff  speaks  this  language.       (  ) 


g.       ^^-'^^^Jli:*^  Bai  kg_round 

Report  the  tallies  for  question  63. 


Qut'st  ion 


(b3)  v;hac  is  the  nighesi  level  of  education  you  will  have  completed  b\  the 
end  of  this  school  vear  (June,  :97  3;.'     (CHECK  ONE  ONLY) 

1)  A  high  school  diplomi  ( 

2)  A  J-Vv^ar   (Associates)  degree  ( 

3)  Bacheloi'Vs  degree  ( 

4)  .\'ork  coward  a  Masters  degree  ( 

5)  Master's  dtgree  or  above  ( 


' '}  ^'PyS^  S'f^  Years  1  ear j un^  Jj\  Fo  1  low  Throng i \ 

Hepi^rL  the  tallies  for  question  69  using  categories  0;   1;  2+. 


Que  >t  ion 


(h9)  Bv  jiiae  1  97  3,  how  many  sciiool  years  will  you  have  tauglit  in  the  Fol- 
low Ihrough  approach?     (INCLrok  YEARS  IN  OIHEH  SCHOOLS.)     If  less  tlian 
«)ne  school  year,  enter  (Q  [0  ] 


\unber  <  f  vears 


i.       f  ♦"fei  t  of  FoIK>v^   ^ ^^^'-^M^'^ JL*1  ^'-^^'hin^g 
Report  the  \allie,s  for  q-iestion  70. 
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H.'U     'j>  h  ha^  'oilow  Hir.  ugh     hangf  J  your  approach  to  tL\ik.hin^'  (CHICK 


1  )     \crv    .lu  i\       (  ) 

^)      \v>t    .It    ail       (  ) 


it't  niii^  (Hit'-.  I  1  >nna  i  ro 


iru'  V  o.nv.u.ii  loiis  were  perfornod  to'*  t-aoh  site  and  tor  t-a^  h  sponsor,     I'Ijo  unit 
ot   .iiialvsis  w.is  thu   tcaLhiag  aidf.     Non-roliow  'Ihrough  teaching  aides  wort^  oni  ttt*d 
ir^'p  iho  I'oinpurat  ions  of  site  and  sponsor   ^Catibtit.s,     The  means  and  st  Midard 
n-Foilow  Through  toachmg  aides  weru  Loniputed  soparatolv. 


aov  1  it  1 1  nis  1  or 


\lsi'  iifo«KM  art'  the  aunbcr  v'f   Lcaihmg  aides   Ln«.'luded  in  each  computation 
(i-^'f   '       t'oilcTw   Ihrougii,   tilt'  nupbor  of  Follow  Ihrough  teaching  aides  at  taM' 
-^ite  and  over  sites  witiun  sponsor;   for  Nun- Follow  Ihrough,    tlie   total   n'jir.ber  ()f 
Non-Follov   Through  tja^hing  aides)  and  the  number  of   teaching  aides  for  whoir  tijo 
Ones 1 1  >nna  1  rt'  is  Aoi  availabif. 


i .       -'^ide^  Sat  i  sfa^  t  iv>n 

Reverse  iiiK,  t>rder  of  value  tor  questions  il,  12,  13,   38,     Add  the  values 
riit^ti^ns  11,   ij,   n.   38.     Report  the  mean  and  standard  deviation. 


Quest  ions 

(II;   It   vou  h.id  ^.our  xtioi'"e,  Would  \ni  work  in  Follow  Through  next  year' 
(C  Hi  (  K  U.\M  ) 


1 )  I)et  in!  tel\  ',es 

2)  ProbabU  ves 
n  ^ndecided 

A;     Probabj\  no 
"i )     lU'f  in  1  te  I  V  no 

I        n<^t  f  ru  1  lar  witri  F^lh^ 


(  ) 

(  ) 

(  ; 

(  ) 

(  ) 

Ihrough     (  )— ^Sliip  to  ()iiestion  H 


ill)  Ke.  ojcni/,ing  that  the  parent  nust  nake  the  final  decision,    if  a  parent 

<iskecl  vour  opinion  would  vou  advise  her  to  enroll  [ler  child  in  a  loll>'W 
Ihrcugn  .  lass ' 


1  )  l_)tf  In  it  t-»lv  vt  s 

2)  Prohablv  vls 

I)  iwdi  i.led 

♦ )  Pr.^h.ih  i  V  ni 


(13)   li  a  irit'iul  askt\l  vour  npmion,  would  vou  advise  hur  to  work  in  follow 


lion  16: 


1  )  Dof  initt'iv  vt-  {  ) 
2)     Probablv  vo->  {  ) 

5)     I  ndt't  laed  (  ) 

-♦)     Probablv  no  (  ) 

b)     Dft  ini tf 1 \  no        (  ) 

(38)   In  general,   how  satibfied  are  vou  vitii  Cht-  way  your  time  is  being  used 

as  a  teavhuii^  <issisLant'     (CUf.CK  OXL) 

1 )  W-rv  sat  isf  led  (  ) 

2)  Sat  1st  led  (  ) 

3)  Have  nixed  feelings  (  ) 
-i)  Dissatisfied  (  ) 
>)     \erv  dissatisfied  (  ) 


Freqjaencj-;^  and  Klnd^  uf^  Jl'ralning 

Do  n_L>c  sum.     Report  separately  for  each  item  a-h  (omit  i)  on  ques- 


(1)  A  tally  of  tlie  "never"  (value  of  I)  responses 

(2)  Mean  and  standard  deviation  for  those  responses  other 
tlian  never  rescaled  as  follows: 


Re^)on_se  Re  sea  le  to 

2  2 

3  5 
^  9 
S  22 
b  36 


Quest  ion 


Ub)  P>eic)W  art-  several  typos  of  pre-  or  in-service  training  you  may  iiave 
rtve ived   for  vour  pr     ent  assignment.     Indicate  below  how  often  ibis 
year  %ou  r^'Leived  ea*.-h  oi    the  following  types  of  training.     Use  thit> 


ale: 


1  "  N'evel 

2  =  About  once  or  twioe  a  vea^* 
y  ^  Abc^ut  everv  other  month 

4  -  Ab(^o  I  onoe  a  month 

')  -  About  2  to  3  times  a  month 

h  =  About  once  a  week  or  more 


Matter  la  Is  n^ailed  to  vou  for  vour  own  use.  Q 
Visits  or  demonstrations  in  your  own  classroom.  Q 
Vis  It  in^^,  anti  observing  work  of  other  teachers   in  L) 


the  1  r  c  lassro(^nis . 


[{"10 


Work^>tU'pj>  on  Saturdays  or  after  bciiuul. 

i  cnisu 1 tal  :  ns  with  specialists  or  trainers,  not 

I'l  \  vuir  V  1  a-) r>ro  J  '  . 

\  ulcotapes  oi  n>t)dcL  tea».'hing  episodes. 
Vidt'Otapes  of  vourRelf   in  teaching  episodes. 
Othe.  (SPECIFY) 


□ 
□ 
□ 

□ 
□ 

□ 


^  .       Uju.iin^  Krrphasis 

Items  a  through  p — Dc)  not  sum.     Repo  t  the  tallies  for  each  item  in 
question   17  separate! v. 


Qiies  1 1  on 

(17)  Below  are  several  areas  in  which  you  may  have  received  pre-  or  in-service 
training  for  your  teaching  assignment  this  school  year.     Indicate  how 
nuch  enphasii;  v.as  pla^^ed  on  each  of  the  topics  listed.     Use  the  following 
s<.a  le : 


3 


A  great  deal 

Sone 

None 


Helping  the  child  feel   important  as  a  person. 

Developing  enthusiasm  for  learning. 

Developing  basic  skills  such  as  reading,  writing, 
and  math . 

Developing  problem  solving  and  critical  thinking. 

Developing  the  child's  ability  to  work  and  play 
cooperative! V  with  other  children. 

tielning  tht-  viiild  to  make  choices  and  boi  ome  an 
independent   learner . 

Involving  parents  in  theii   child's  learning 
ac ti V  i ties . 

Involving  parents  in  the  op-ration  of  the  school. 

Diagn(^sing  individual  learning  needs. 

uui'Jing  children  in  learning  activities  appropriate 
to  their  needs. 

V  oopt-'rat  1  n^  eftettively  with  other  adults  in  the 
c ' assroom . 

U'o rking  with  s'na  1 1  gmaps  of  children. 

Arranging  tne  ^  lassroont  environment  for  instruction 
(pLu  enient  of  furniture,  miterials,  e<iuiijpient  ,  etc 

Maintaining  dis'  iplme  and  control   in  the  classroom. 


□ 
□ 
□ 

□ 
□ 

□ 

□ 

□ 
□ 
□ 

□ 

□ 
□ 

□ 


M-l  1 


o.      I  sing  rewards  to  influence  pupil  beliavior.  Qj 

p.       Developing  vind        selecting  mater  lais  to  suit  [J 
(.urrirulum  ^biectives. 


<1 ,       Cla^srv>o'*^  Description — Flexible_/Stjuc  tured 

Onil   itefis  e  and  1.     Reverse  order  of  v^Iuo  for  question  ^0,   1 1  s 
a,  d,  f,   L,    j,  k,  (Do  not  reverse  b,  c,  g,  or  h.^     Report  the  mean  anvl  stan- 

dard deviation  of  the  sum  oi   ihv  responses. 


Qiie s_t  ion 

(JO)  Classrojm.s  differ  m  many  ways  depending  upon  the  philosophv  and  gua  1 
of  tile  teaching  staff,  needs  of  children,  etc.     hach  statement   m  Col- 
ur.n  A  is  n^atcbed  with  a  contrasting  statement  in  Column  B.     For  e^^.  h 
pair,  place  an  X  inside  the  parenthe<^es  which  comes  closest  to  describ 
i ng  ycur  own  l lassroom . 


\ 


k      unn  A 


a .  Ch i  Idren  work 
independent  I v 

b.  leacher  im- 
parts infor- 
mation and 
provid**b 
demons t  r a - 

t  ion*- 

c .  Ad u 1 1 s  ini- 
tiate inter- 
actions with 
ch  i  Idren 

d  .     Tmphas  i  on 
c-^\^  t  i  ona  I 
needs 

e.  l^Uesired 
bt^nav  i  or 
1 s  V  or- 
rec  ted 

.  \arious 
^\   at.  t  ivi  t  i es 
\take  pi  <u  t' 
at  the 
-^arie  t  i  ne 

4.  Lesson  plan 
is  ♦  <>|  1  owed 
.  losvlv 


A 1 mo  s  t 
a  1 wa  y  s 
1  ike"  A 

(  I) 
(  1) 


(  i) 


(  I) 


(  1) 


(  1) 


(  0 


(  :) 

(  1) 


(  2) 


(  2) 


(  2) 


(  2) 


Somewhat 
1  ike  A  and 
son.ewhat 
like  B 

(  3) 
(  3) 


(  3) 


(  3) 


(  3) 


(  3) 


(  3) 


(  A) 


(  A) 


(  A) 


(  M 


(  4) 


(  4) 


Almost 
always 
like  B 

(  5) 
(  5) 


(  5) 


(  5) 


(  5) 


(  5) 


(  3) 


Ct)lumn  B 


Children  work  under 
adult  supervision 

Children  gather  in- 
formation on  tbeir 
own 


Children  init»at^. 
IP terac  t  ion.-*  wi  th 
adul ts 

Tmpb.asis  on  ^ubje^t 
nui  t  e  r 

Cndesired  behavior 
is  ignored 


Al  I   the     las^   i  s 
engaged    in  tiie 
ac  t  iv  it  V 


Lesson  pi  an  is  l  U 
ihi(^ 


Work  and 
plav  are 
d 1  St inga 1  shed 

Chi  idren 
ohoosf  their 
<.'wn  aotivi- 
t  ies  ,«iui 
ma  C  t*  r  i  a  1  s 

Ind  ividua I 
needs 
don  i  aaiU 

1  Idren 
interaj.  c 
freclv  with 
each  oilier 

Praise  and 
a^  c^val 
given  for 
spec  if  io 
acoompl ish- 
nencs 

Ch  i  idren 
change 
places 
f  reeb' 


\ Ipo^ t 
a Iwavs 
like  A 

(     1  ) 


(  n 


(  1) 


^  1) 


1) 


(  I) 


(  2) 


(  I) 


{  2) 


(  2) 


(  2) 


Somewhat 
1  ike  A  and 
somewhat 
like  B 

(  3) 


(  3) 


(  3) 


(  3) 


(  3) 


(  3) 


(  '0 


(  4) 


(  A) 


(  4) 


(  4) 


AlPi.»st 
a Iwavs 
1  ike  B 

(  5) 


(  5) 


(  5) 


(  5) 


(  5) 


(  3) 


Co  Um.n  B 


Work  and  play  are 
not  d  1  s  I  ingLi  isiied 

Teaching  staft  de- 
termines activities 
and  materials 


Group  needs  domi- 
nant 

Children  do  not  in- 
teract freely  with 
each  other 

Praise  and  approval 
given  wi  thout  re- 
gard to  spec  1  f  ic 
acconpl ishments 


Children  have  as- 
signed seats 


*      Ethnic  It  y ,  Qnes  t  ion  28 

Tally  the  number  cf  each  ethnic  background.     Use  the  total  number  for 
a  site  on  iteir  1-8. 


Que^t  ion 

(28)  Are  you:    American  Indian 
Xegro/black 
Oriental 

Spanish  surname:     Mexican  Ar erican 
Puerto  Rican 
Other  Spanish  speaking 

Caucasian/ white 
Other  (SPECIFY) 


a- 13 


'Mv^ii.Mi  report   the  neaa  aivi  staa<.i<>ro  ueviatioii.     Vor  qiu 

Ki ,   re  pert   L'le  ti'lies,     1  v\"h  i  ue  the  tvillie-.  UT  response  value-^  1  aiuI  2. 


Qiu'-.  t  Kins 

(i-*)  i)v^  vou  tiavv    iiiv  ihiKiren  in  this  «.  la^b  t  ron  hopeb  m  wiiieh  another 
1  ing\i<ige        ustid  r^ore  often  than  Cnglisn/ 

1  )     ^e^  (      )     How  "lanv  :  nTI 

2)  No  (  )--*-Skip  to  OiR-stion  lb 
\ )     Hon  '  t  know       (     )  — ^Sk  i  p  to  Que.^  t  i  on  lb 

(I'"))   U'I'w         t'w_'  te>it.hing  t>t<iff  sDeaks   Llie  hoi?e   language  o\    these  children' 

I)     I  do,  <ind  .so  doe.s  at   least  one  other  staff  member  (  ) 

in  thi^  V  la.s.s. 

J)     I  do,  but  no  other  staft  member  in  this  class  does.  (  ) 

3)  I  do  not,  but  at  least  one       .er  staff  member  in  (  ) 
this  class  does. 

-0     No  member  of  tiie  teaelung  staff  speaks  tiiis  langucige.       (  ) 

g.      A I d  e  ^  s  Cl a  s  s  r  o  cm  Ac  1 1 v  i  t  y - -Qu  e  s  t  i  o  n 

Report  a  tally  for  ea^ h   item  separately.     ('ategorize  responses  into 
f  i  ve  t  lasse.s  :     1 ;  2;   3  ;     ,   3  . 


Que.s t  ion 

ill)  For  eacii  r.t   the  items  in  the  following  list,  please  indi^.cite  how  often 
you  yourself  take  pai t  in  this  activitv.     Use  the  following  scale: 


1  = 

Verv 

of  ten 

Some- 

t  ires 

3  = 

Rare 

i  /  or  '^"^^ 

cr  because  it   is  carried  out  by  others 

Rare 

Iv 

er  because  iL  is  not   important  in  this 

t  lass 

5 

Ra  r  e 

ly 

er  because  it  is  no t  pos s ible  in  t in s  ( 

1  <1SS 

a  , 

'..ork 

Wl  tfl 

small  groups  in  reading,  writing,  math,  etc. 

□ 

b. 

u'ork 

w  i  t  h 

small  gro 

ups  in  art,  m,usic,  drama,  etc. 

□ 

(  . 

Uc  r  k 

w  1 1  h 

the  uncle 

<^lass  in  reading,  writing,  math,  etc. 

□ 

d. 

Ivor  k 

w  1  t  h 

the  whole 

class  in  art,  mi  is  it  ,  drama,  etc. 

□ 

e  i 

i;ork 
1.1  tn 

u  1  til 
et.  . 

ind I V idua 

1  <.  h  1  Idren  in  read  ing,  VvT  it  ing, 

□ 

t  . 

'  M  ^  r  k 

w  1 1  n 

1  nd  i  V  idua 

1  c'n  1 1  dren  i  n  <ir  t ,  m.us  i  c  ,  drama  ,  (He. 

□ 

^• 

He  1  p 

<  hi  id 

ren  get  a 

long  with  one  anther. 

□ 

h. 

Ht  1  p 

I  h 1 1 dren  fee  1 

HK^re  sure  of   t  hemse  1  ves  . 

□ 

H-14 
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Prepare  ruiLeriaLs  for  bulletin  buards,  seat  work,  etc. 

Keep  attendance  ret'ordsj  collect  milk  money,  call  the 
I ,  set  out  nater  iali>,  etc  . 

Supervise  children  during  lunch >  on  the  playground, 
on  field  trips,  etc. 

Serve  or  help  serve*  food  or  ^nacks,  tiean  up  after 
luncii,  etc  . 

Help  develop  and  plan  learning  activities. 
Keep  order  in  clctss. 

Visit  or  meet  with  parents  at  school  or  in  their  homes. 


Appendix  1 
SPECIFICATION  FOR  PROCESSING  TEST  DATA 
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Appendix  I 


SPEClFICAiU)N  FOR  PROCESSING  TFST  DATA 


As  cKe  first  step  irt  c^reating  the  classroom  level  file  of  test  scores,  a  record 
of  ttiSt  sooreti  for  cd^h  ^hild  in  eaeh  observer  classroom  was  produced.     What  fol- 
lows is  a  list  of  the  it^sc  scores  obtained  for  each  grade  level/entering  grade 
and  details  of  how  the  test  scores  were  computed. 


I.  Spring  1973  -  Metropolitan  Achievement  'lest  (M/T)  -  Primary  I  - 
Form  F.     For  entering  and  non-entering  first  grade. 


 Subtest  Form  No.  Card  Column        Maximum  Sv  ore 

Word  Analysis  863  33-72  40 

Total  Reading  86A  33-67 

866  33-74 

Math  867  33-67 

868  33-59 


35^ 

35| 
27/ 


77 
62 


Scoring  procedure:  score  1  point  for  each  item  coded  "1."  if  a  child  took  the 
test  and  obtains  a  score  of  zero  (none  correct),  he  is  given  a  score  of  "  ." 

Criteria  for  presence  or  absence  of  test: 

1)  Word  analysis  -  if  cc.   33-72  of  form  865  are  all  zero,  the  test 
is  absen t . 

2)  Total  reading  -  this  test  is  a  combination  of  subtest  word  knowl- 
edge Forr.  864  and  Reading  Form  866.     Since  these  2  tests  were 
administered  on  3  different  days,   the  child  must  have  been  present 
on  all   3  days  to  have  a  total  reading  score.     The  tests  were 
administered  .is  follows: 


No.  of  Sitting 
 Test   F>rm  No.      Card  Column      I  terns  Day 

Word  Knowledge  864  33-67  35  1 


Reading  866 

146-7 


5  13  2 

74  29  3 


If  a  child  has  any  ^et  of  these  items  all  zero,  the  child  is  considered  absent 
for  total  reading. 


))  Forr.  Hh  f  .  5  J-h  /  ua*^  aimi  n  i  s  to  rd  on  day  4  aiui  lorin  8<i8  r. 
3^-")'^  ^va-^  cid-^ii  ni-;  Lor<.'vi  day  >,  if  i-iiiuT  ihcst-  torns  ari' 
all   /.t'To  for  tho  i\)lunins  specitifd,   llu'  child  wa^  absc^nt  for 


il.   "^priiu   I'^M  -  M.'t  ropal  I  tan  AuMovfiriL-nt   lest  'MAI)  -  i:U-nunlarv  - 
Fo  t  n  F .     h\^i   third  ^  ra  do  . 


Sab  tc  St 

Form  No. 

Can!  Coliiinn 

Max  i  mum 

Scort^ 

lo  t  a  I  Koad  i  iii; 

8  7h 
877 
878 

n-54 
33-77 

95 

I  <in^ua^o 

879 
880 

33-61 
33-33 

30 

Matii  Compulation 

882 

3  3-72 

40 

Math  Concepts 

883 

33-72 

40 

Math  Probleni 
So Iving 

884 

33-h7 

33 

lota  I  Math 

882-884 

115 

SLoring  pnu^edurc:     Score  L  point  tor  oach  item  coded  "I."     if  a  child  took  a 
It-sC  and  obtains  a  Score  of  zero  (none  correct)  he  is  given  a  score  of  "0." 

Criteria  for  presence  or  absence  of  a  test:     A  child  must  have  all  forms  present 
for  a  particular  test  to  have  tako'^'.  the  test.     A  form  is  considered  absent  if  all 
items  are  ze ro .      Ihe  subsets  which  constitute   Total  Reading  were  administered  on 
thL'  first  day;  ther^'fore,  if  the  child  was  absent  on  day  1,  he  will  not  iiave  a 
Total  Reading  score.     Ihe  subtests  for  Total  Math  were  aoministered  on  days  4 
and  5;  therefore,  if  the  child  was  absent  on  either  one  or  both  of  these  days, 
no  h>Lal  Math  score  was  computed. 

III.  Spring  U)73  -  Third  Grade. 

In^te  11  ectural  Achievement  Responsib  i  li^ty  Scale  (lAR)  -  Form  887  - 
cc.    33-b6,  Score  I  point  for  each  item  ( oded  "1."     Ihere  were  34 
items  on  the  lAR.     The  items  were  scored  by  success  and  failure 
ite-ns  (17  items  for  each).     items  //I,  2,  3,  6,  9,   12,  13,  16 »  17, 
20,  21,  2'4 ,  23,  2o,  29,  31,   32  were  used  for  S'ucess,  and  the  re- 
mainder of  the  items  were  used  for  failure.     lest  is  not  taken  if 
form  IS  absent.     The  success  raw  score  represents  the  number  of 
responses  att  ribiit  ing  success  to  i  nterna I   force  ;  conversely ,  the 
raw  ^core  fo.    failure  represents  the  number  of  responses  attribut'- 
ink?  failure  lo  internal  force. 
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^ ■  "    C^'^opt 'jr th  St'  Ij  J lji_t r e in_J  n v^n_c ^ )ry  (Co opt Tsni  th) 


88y 

889 


Card  Cojumn 
5  5-)  3 


No .  01 
I  terns 


37 


}■>» 


Score  point  tor  eaoh  item  coded  "1."     Bight  items  were  used  as  a  validity  test; 
therefore,   the  score  range  wai^  0-30.     The  test  was  not  taken  if  either  or  both 
forms  are  absent.     Ihe  total  number  of  responses  indicating  self-esteem  consti- 
tutes the  raw  score. 


C.       Raven's  Coloured  Progressive  Matrices  (Ravens)  - 
.   33-39,  Score  1  point  for  each  item  coded  "1, 
0-27.     lest  is  not  taken  if  form  is  absent. 


Form  890  - 
'    Score  range 


Wide  Range  Achievement  Test  (^'K/\T)  -  Foim  951  -  Booklet  lOA 
Fal i  19b9  -  For  kindergarten. 


Sub  tes  t 


Read  ing 


Spell ing 


Math 


[ tern  Description 

2  letters  in  a  name 
Naming  13  letters 
Recognizing  19  letters 
Word  reading  aloud 

Reading  subscore 

Name  spelling 
Copying  marks  (1-9) 
Copying  marks  (iO-18) 
Spelling  from  dictation 

Spelling  subscore 

Counting  15  dots  aloud 
Oral  numoers 
Showing  fingers 
Wh  i  ch  is  mo  re 
Solving  problems 
Written  computation 

Math  subscore 

Total  WRAT  score 


Maximum  Score 


2 
13 
10 
iO 

35 


5 
2 
2 
3 
4 

24 

84 


In  most  instancies,  tho  maximum  store  represents  the  sum  of  the  correct  entries 
in  the  fields  specified. 

The  formula  for  scoring  this  item  is  7  +  1 .     Since  an  integer  dividing  procedure 
is  used,  the  quotient  is  rounded  off  to  the  lowest  whole  number.  Therefore, 
even  if  a  child  counts  15  dots,   the  maximum  score  is  still  8. 
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.lilt' 


Raijji^'  j\ij^JLt'  vemenc   K'S  l  (y^^^J)  -  Book  i  e  I 


For  k  hultirk^arten . 
Siibcerfl  Form 


Math 


L  t em  Do s c  r i p 1 1 on 


-  Fall  1970 


Max!  mum  So  pro'' 


r  Ro^  o^n  I  / 1  ni^  I   It^Lors  in  a  namt^ 

-(  Matdnnj.',  10  letu-r.s  10 

^  Naming  i  3  letters  13 

-vord  reading  alo'ici  j  0 

Reading  subscore  33 

r  Cupvi ng  marks  18 
-<  Name  spelling  2^ 
^Spelling  from  dictation  3 

Spelling  subscore 

Counting  13  dots  aloud 
Oral  numbers 
J  Showing  fingers 
Which  is  more 
Solving  problems 
^^Written  computat  ion 

Math  svibscore   

Total  WRAT  score  84 


23 


3 
2 

2 
3 

4 

24 


^ilde_Ran^e  .Achievement  ies  t  (i^RAT)  -  Booklet  K-4 
For  kindergarten. 


Fail  1971 


Subtest 
Reading 


Spell  inj^ 


Math 


Form 
N'o. 


Item  Description 


^Recognizing  2  Ijtters  in  a  name 

738 


Recognizing  10  letters  an i  namin *  13  letters 
Word  reading  aloud 

Reading  subscore 


/"Copying  marks 
\  Name  spelling 
7  38      Spelling  words  from  dictation 


738 


Spelling  subscore 

{Counting  13  dots  aloud 
Reading  numbers,  oral  and  written  arithmetic 

Math  subscore 

Total  WRAT  score 


Maximum 
Score'^ 


28 

8^^ 
16 


24_ 
91 


In  most  instances,  the  maximum  score  represents  the  sum  of  the  correct  entries 
in  the  fields  specified. 

k 

In  either  letter  recogni/-ing  or  name  spelling  tiie  number  of  letters  recognized 
correctly  is  coded  as  follows:     1  =  One,  2  =  At  least  2. 

'Ihe  formula  for  scoring  this  item  is      +  1.     S^-ice  an  integer  dividing  pro- 
cedure is  used,   the  quotient  is  rounded  off  to  the  lowest  whole  number.     '1  he  re- 
fore  ,  even  if  a  child  counts  15  dots,  the  maximum  score  is  still  8. 
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CLASSROOM  ROSTER"-DEMOGR.\PHIC  INFORM/\TION  FORM 


\  At 


6 

8 

10 

1 1 

\2 
13 


lb 

i: 

18 

11 


For  ca<  :i  via->sroo.>  th.u  was  obstTved  on  at  Ifast  oUkj  Jav,  the  f oi  lovv'ing 
or'-^ation  was  fc«».  orded  fro*;-  the  (  lassroom  Hosier  Kor^^^  Spring  197  3. 


lables 

Xirber  of  (.liKlren  m  the  v^lassrooD  listed  on  the  roster. 

\iirber  of  «.hildren  who  left  the  ^  lass  betore  J/1/73. 

\'it.ber  of  L'hildren  wh.o  entered  oilier  ihcin  at  the  beginning  of  the  s».hooI 
\  ear . 

Nunber  or  (.hildren  utio  left  the  .lass  during  the  school  year. 

Number  of  no  response  on  ago   m  veai*. 

Of  non-blank  entries,  average  agt.    in  months  as  of  Januvirv  I,    1  97  3. 
St .  n\d_a^rd  deviation  of  age  i  n  ru)  n  1 1 1  s  . 

Miirber  ot  n^'  respon-.e  on  sex. 

N'ut:iber  of  "tales. 

Napber  of  no  response  or  don't  know  for  ethnicity. 

N'urber  of  blacks. 

.Number  of  Caucasian  or  White. 

Xunber  of  none  (9),  don't  knLW  (0)  or  no  response  (blank)  on  first  language. 

\'uiTber  of  children  uith  other  than  hnglish  as  a  first  language. 

N*v:'iber  .^f  not  available   (77),  don't  know  (88),  or  no  response   (99)  on  Ix^L''' 
•-^ontlis  Hea  '  Stvirt  and  months  equivalent. 

Nunber  of  vhildren  witn  Head  Start  eAperience  or  equivalent  (0i-A8  on  t;^ij.iiej 
entry) . 

None  (00)  . 

I  t.  !'). 

II  to  20 
21  Lo  30. 
Above  30. 

'^tJrer   (7  7  ,       ,  99)  . 

^lean  nun-ber  of  nonths  Fi  ^'.^perienee  (e\(.lude  those  students  in  the  "(.ither" 
.  ,it  t'g.'r^ )  . 

Nu.  her        children  with*  no  response  on  number  of  davs  absent. 
Mccin  nurhtr  of  d<i\s  absent  for  tliose  who  iuid  a  response. 
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Appendix  K 

rNIFORMITY  OF  THK  CLASSROOM  OBSI':RVATiO.\  DATA 


4 


V'MHfk  o\  (OP'S  (I'MPifit:!)  p[K  i)AY— BY  SPONSOR'S  SIIKS 
^A<!iii«^toa  to  IncliKU  OpIv  KMO^s  "iti^  50  or  More  Frainos) 


Spor.rfor  and  Site 

Kor     1 1  sponsors 

Far  West  Lab 

Berkei  ey ,  Cal  if . ' 
Dalutli,  Minn, 
[.obanon,  N'.H. 
Salt  Lako  Cii\ ,  Utah 
Tacona^  Wash. 

Moines,  Iowa 
Fort  Worth,  Texas 
LaFa^'ette,  (-a . 
lakewood,  N.J. 
Newark,  N.J. 
Lincoln,  Nebra.ska 

Brattleboro,  verinont 
Fall  River,  Mass. 
New  York,  P.S. 
Philadelphia  II,  Pa. 
Tuskegee,  Ala. 

University  of  Oregon 
F.  St.  Louis,  III. 
New  York,   P.S.  137K 
Racine,  W^isc  . 
Tupelo,  Miss. 
Providence,  R.I. 

New*  Yo  r  k       .  S  .  tYx 
Phi ladelph  la  VI ,  Pa . 
Portageville,  Mo. 
Kansas  City,  Mo. 
Louisville,  Ky . 

High/Scope  Fducational  Re- 
s  ea  r  c  h      ^j^nd  aj:  ion 

(Greenwood,  Miss. 

Ft.  Walton  Beach,  Fla. 

New  York,  P.S.  92M 

(•reeley,  Colo. 

Denv-jr,  Coio. 

Burlington,  Vermont 
Philadelphia  IV,  Pa. 
Pater  son,  N'.J. 
Rosebud ,  Texas 
Smith field,  N.C. 


X 

18.88 

19.>^3 
19.U0 
18.83 
19.90 
19.14 

14.93 
19.73 
19.33 
19.29 
19.92 
19.67 

17.88 
18.87 
19.17 
19.04 
19.93 

17.07 
19.50 
19.73 
18.33 
17.96 

16.86 
19.50 
19.81 
19.63 
19.40 


17.30 
19.53 
15.70 
19.92 
19.40 

18.13 
19.67 
19.30 
17.50 
19.71 


S.j). 
2.17 


1 .00 
1.36 
.40 
1.81 

5  79 
.69 
1.18 
1 .54 
.28 
. /  6 


1.51 
1.25 
2.09 
1  .20 
.37 

4.67 
.73 
.52 
2.05 
2.06 

2.  18 
.82 
.48 
.93 

1.10 


3.05 
.90 

1.07 
.28 

1.  ♦O 

1.87 
.55 
1  .32 
2.34 
.75 


Number 
of  Davs 
()_b^secyed 

1  ,  101 

30 
30 
30 
30 
29 

30 
30 
27 
28 
25 
30 

24 
)0 
30 
28 
29 

29 
24 
30 
30 
28 

14* 

30 
27 
30 
30 


30 
30 
27 
24 
30 

3C 
30 
30 
24 

2^' 


Restrictioas  pla^od  on  observing  children  reduced  tlie  total  num- 
ber of  observation  days  by  ten. 
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y:\KAn  w^nwR  of  frami s  coMpn;m)--BY  spoxsor's  srrrs 

(Ino  hides  Onlv  Vno^e  OOPS  with  50  or  Moro  Franes) 


Spon.si^M'  aiul  Silt-   

Berk t' lev,  Calif. 
Duluth,  Minn . 
Lebanon,  N.H. 
Salt  lake  City,  Utah 
1  ac'ona ,  Kash  . 

^  "  ^^^^ 3 LtL-iliLi^i'J^iiUS: 
Des  Moines,  Iowa 

Fort  Kortn,  Texas 

LaF«ivetCe,  (la. 

Lakewood ,  N.J. 

Newark,  X. J . 

Lincoln,  Nebraska 

B_ank_S£re_et 

Brattleboro,  Vermont 
Fall  River,  Mass. 
New  York,  P.S. 
Philadelphia  II,  Pa. 
Tuskegee ,  Ala . 

^'-^  iv^rg_^^y  .^^  Oregon 
L.  SC.  loui's,  lilT 
New  York,  P.S.  n7K 
Raoine,  Wise. 
Tupelo,  Miss. 
Providence,  R.I. 

I' n i V e r s i  t y  of  Ka n s a s 
"New  York,  P.S.  77X^ 
Philadelphia  VI ,  Pa. 
Portageville,  Mo. 
Kansas  Cicy,  Mo. 
Louisville,  Ky. 

Higii/Scope  Kducational  Re- 

(Greenwood ,  Miss . 
Ft.  Walton  Beach,  Fla. 
New  York,  P.S.  92M 
(Jreeley,  Colo. 
Denver,  Colo. 

^  ^ ^,caj_^ o n  Devel  o p me n t  Center 
Burlington,  Vermont 
Philadelphia  IV,  Pa. 
Paterson,  N.J. 
Rosebud ,  Texas 
Snithf  ieM,  N.C. 


Number 
of  Dav^ 

X  S.I).  Observed 


hi  .11 

1  mi 
1  ,  u  1  i 

h9 .  36 

4.22 

30 

71.72 

3.41 

30 

65.16 

7  .44 

30 

69.42 

3.77 

30 

DO .  yu 

7  7n 

/  .  /  Kf 

59.68 

10.14 

30 

73.  3A 

1 .84 

30 

7A .  10 

i.57 

27 

65.08 

4.88 

28 

oo .  yo 

.  I '0 

72.33 

2.57 

30 

60. 57 

4.06 

24 

67  .89 

4.55 

30 

67.86 

2.47 

30 

66.68 

5.61 

28 

70.82 

4.84 

29 

6A  .66 

4 . 48 

29 

66 . 1 A 

2.73 

24 

2.79 

30 

71.49 

2.04 

30 

64  .89 

5.22 

oo 

3.33 

14 

69.77 

6.  27 

30 

67.83 

4.62 

27 

3.  38 

30 

61.64 

7.42 

30 

65.31 

4 .  38 

30 

67.09 

3.81 

30 

74.09 

1.06 

27 

68.57 

2.97 

24 

64.81 

3.70 

30 

59.9  3 

2.44 

30 

67.83 

'').87 

30 

71.98 

2.97 

30 

61.06 

3.63 

24 

67.78 

^) ,  1  6 

2'4 
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Appendix  L 

INDIVIDUAL  OBSERVER  RELIABILITY  RATINGS— BY  SPONSOR 


Er|c  '/j'i 


^iriRAlY  RAThS*  'S'OR  THh  UMAt  AND  HOW  tODjb  BY  '^AR  Uii>T  Oii^iH\'\:Rs 


Site  4nJ 


or  More 


9W 

90/ 

86/ 

.9^/ 

1.0' 

.57 

.50/ 

0.0/ 

.67/ 

1.0/ 

.8u 

50 

I.O 

.82 

.75 

.81 

1.0 

80 

1  0 

0  0 

1.0 

1.0 

1  0'' 

!  0/ 

1  0' 

SO' 

1.0/ 

.90/ 

.82/ 

7  5/ 

.50/ 

.67/ 

1.0/ 

HI 

}8 

.4(, 

81 

82 

1  0 

96 

.,^5 

.^^0 

1  .(! 

1.0 

1  0 

1  0 

1  tbanv  n 


Salt  lake  i,  Itv 
Or^d**  1 


.<4  0<^<i 

<„raJ«>  1 


9h' 

'it/ 

;  1 , 

62/ 

86/ 

.71/ 

.92/ 

.60/ 

^0 

H< 

^1 

.75 

96 

75 

.60 

6"'  ' 

0?  ' 

67/ 

.80/ 

3  3/ 

.60/ 

.71/ 

9i/ 

50/ 

43/ 

6U 

76 

*)7 

^7 

29 

67 

61 

.80 

.50 

.60 

1 

.'^/ 

.88/ 

8J/ 

91/ 

1.0/ 

.  ^6/ 

1  U 

>^  i 

8} 

9h 

25 

80 

Ah  ' 

.  7S  ' 

7V/ 

75/ 

1.0/ 

.88/ 

87/ 

1.0/ 

50/ 

81 

SI 

1.0 

7  5 

70 

88 

.91 

67 

60 

80 

1  0' 

1  0/ 

.90/ 

.67/ 

,7  5/ 

75/ 

50/ 

.  *() 

29 

82 

1  0 

91 

.75 

.40 

1  'J 

1  0/ 

75/ 

1.0  ' 

.79/ 

1.0/ 

.38/ 

1  0 

.5*> 

.63 

1  0 

1  0 

.^0 

75' 

1  0 

.89' 

.79' 

.H6/ 

1  0/ 

76/ 

60/ 

43/ 

79 

8.  J 

78 

7  \ 

1  0 

9^ 

60 

8<J 

,96 

.  75 

60 

^2 

'5  ' 

.88, 

I  U' 

58' 

w 

I  0, 

9J/ 

1.0/ 

.  ^h! 

.7] 

1.0 

?0 

.50 

.82 

.80 

1.0 

.93 

.50 

.80 

I  0/ 
1  0 


.8U  / 
1  0 

1  0/ 
1  0 


75  ' 
.75 

1  0/ 
1.0 


0  0/ 
0  0 

0.0/ 

0  0 


0<i/ 
1.0 


.50/  .20/ 
.50  1.0 


0  0/ 

0  0 

14/ 

1  0 


10/ 
1  0 

13/ 
33 


0  0/ 
0  0 


.50/ 
i.O 


50/ 
50 


1.0/ 
1.0 

.67/ 
\A) 


.50/ 
1  0 

.67/ 
1.0 


1.0/ 
1  0 

1  0/ 
1.0 


1  0/ 
I.O 

1.0/ 

.67 


1.0/ 
1  0 

1  0' 
1.0 


1.0/ 
3) 

1.0/ 

50 


0  0/ 

0  0 

1  0/ 
1.0 


HOW  rode-.--Criterlon  Instance 


Site  4nd 

fix  jr 

or  Ie«,s 

Rat 

A 

~  J'S 

7oP  _ 

r  N 

WllAT 

"hou 

Serxt;  lev 

'  rade  1 

1  0' 

1  U 

6V 

I  '}' 

1  c 

1  0' 

.67/ 

0  0/ 

1.0/ 

1  0/ 

14/ 

1  0' 

.50/ 

.84 

74/ 

S5 

8<J 

90 

70 

.67 

1.0 

0  0 

,50 

.50 

.50 

.50 

1  0 

78 

(.raJe  3 

83/ 

82/ 

88' 

1  0/ 

1.0/ 

.67/ 

25 ' 

1.0/ 

1.0/ 

.50/ 

50/ 

1,0/ 

83 

.8i/ 

5-4 

78 

.25 

1.0 

l.(- 

50 

^7 

50 

25 

.67 

73 

Dulutn 

or^de  1 

67  ' 

.h6/ 

1  0/ 

88/ 

88/ 

.50/ 

0.0/ 

I  0/ 

75/ 

0.0/ 

1.0' 

.50/ 

.78 

74/ 

.96 

1  .n 

1  0 

50 

1.0 

1.0 

.50 

0.0 

50 

i  .0 

0.0 

.25 

.50 

.83 

Grade  3 

. 

83/ 

66/ 

1.0' 

0.0/ 

0.0/ 

50/ 

0  0/ 

0.0/ 

1  0/ 

25/ 

0.0/ 

20/ 

.64 

.67/ 

6^ 

63 

84 

50 

0  0 

0.0 

1.0 

0.0 

0  0 

^7 

,  33 

0,0 

.50 

56 

1 ebanon 

ijrad«?  ! 

1  0 

I  0 

.^9/ 

0  0/ 

0  0/ 

88/ 

1.0/ 

0.0/ 

1.0/ 

1.0/ 

1  0/ 

1  0/ 

1.0/ 

.81 

.92/ 

U  0 

0.0 

88 

.50 

0  0 

1.0 

.  n 

I.O 

1.0 

.50 

64 

i.rade  3 

89 

92/ 

1  0. 

.88/ 

1.0/ 

0  0/ 

1  0/ 

.50/ 

.  n/ 

1,0/ 

1.0/ 

.83 

.88/ 

93 

H  \ 

6"' 

69 

71 

88 

1  0 

0.0 

1.0 

,50 

.67 

.75 

50 

.76 

*^alt  Lake  t^it> 

',rad«  1 

.8^/ 

.80/ 

82/ 

86/ 

.75/ 

.75/ 

.17/ 

25/ 

1.0/ 

.67/ 

.38/ 

n/ 

{)  0 

.74 

.71/ 

91 

97 

1  0 

-43 

1  0 

1.0 

1.0 

.67 

I  0 

13 

0  0 

.81 

f,rade  J 

1.0/ 

1  0/ 

^0/ 

.  n/ 

,78/ 

I  0/ 

50/ 

50/ 

1.0/ 

67/ 

33/ 

25/ 

.25/ 

.81 

.75/ 

9h 

1.0 

97 

08 

88 

1.0 

\,j>- — 

1.0 

.67 

,33 

33 

.50 

81 

Lradt"  1 

I  0' 

1  IV 

90/ 

1  0/ 

67/ 

.22/ 

1.0/ 

0.0/ 

1  0/ 

1  0/ 

.50 

1.0/ 
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Appendix  N 

ASSESSMEis'T  OF  THE  STABILITY  OF  THE  IMPLEMENTATION  SCORES 


Appendix  N 

ASSESSMENT  OF  TliF.  STAi3ILITY  OF  Tiii:  I^[PLE^^ENTATION  SCORES 


The  accuracy  and  stability  of  the  implementation  score  assigned  to 
a  particular  Follow  Through  classroom  for  a  particular  variable  depends 
on  the  accuracy  of  the  quintile  estimates  and  the  accuracy  of  the  esti- 
mate of  the  Follow  Through  classroom  value.     Error  in  estimating  the 
quintiles  comes  from  "sampling'*  Non-Follow  Through  classrooms  and  from 
"sampling"  classdays  for  each  classroom.     The  former  is  related  to  the 
number  of  classrooms  observed  and  the  procedure  of  sampling  classrooms; 
the  latter  is  related  to  the  day-to-day  variability  of  Non-Follow  Through 
classrooms.     The  stability  of  the  quintile  estimates  is  examined  in 
Section  1. 

The  accuracy  of  the  estimate  of  the  Follow  Through  classroom  value 
depends  on  the  location  of  the  classroom  value  in  relation  to  the  quintile 
cutpoints  and  on  the  magnitude  of  the  day-to-day  variability  of  the 
variable  under  consideration. If  the  classroom  value  is  much  larger  than 
the  fourth  quintile  cutpoint,  then  the  implementation  score  will  be  cor- 
rect with  a  high  degree  of  certainty  even  if  the  day  to  day  variability 
is  quite  large.     On  the  other  hand,  if  the  classroom  value  is  near  a 
quintile  cutpoint,  ihe  day  to  day  variability  may  need  to  be  quite  low 
for  the  implementation  score  to  be  reliable.     This  issue  is  examined  in 
Section  2. 


1.      The  Stability  of  the  Quintile  Cutpoints 

There  are  two  factors  that  relate  to  the  stability  and  accuracy  of 
the  quintile  cutpoints  c'^^^ 

-    Sampling  of  classdays  for  each  Non-Follow  Through  classroom. 

Sampling  of  Non-Follow  Through  classrooms. 

The  former  is  related  to  the  day  to  day  variability  found  in  Non-Follow 
Through  classrooms;  the  latter  is  related  to  the  number  of  classrooms 


'^Related  issues  of  the  reliability  and  validity  of  the  classroom  obser- 
vation data  are  pursued  in  Chapter  IV. 

>'«*The  assumption  throughout  this  section  is  that  there  is  a  hypothetical 
population  of  Non-Follow  Through  classrooms  and  that  the  quintile  cut^ 
points  that  arc  based  on  the  Classroom  Observation  data  are  estimates 
of  the  population  quintile  cutpoints. 
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observed  aiul  the  procedurt'  of  sampling  classrooms.     Tiiese  factors  are 
relevant  vv^hen  an  implementation  score  is  interpreted  as  an  estimate  of 
a  Follow  Through  classroom's  location  relative  to  the  total  population 
of  classrooms  that  may  be  considered  Non-Follow  Through  corap£.risons, 
Lven  if  we  consider  the  procedure  of  obtaining  implementatioti  scores  as 
a  way  of  scaling  the  scores  of  Follow  Through  classrooms,  the  stability 
of  sucli  a  scale  is  certainly  of  interest.     Throughout  this  section  we 
will  assume  that  the  Non-Follow  Through  classrooms  are  a  random  sample. 
This  assumption  is  obviously  violated,  but  it  is  necessary  for  the  sake 
of  obtaining  any  notion  of  the  stability  of  the  quintile  estimates. 

For  the  sake  of  simplicity,  we  will  assume  that  the  COX  variable 
under  consideration  is  continuous.     The  quintile  cutpoints  are  based  on 
35  or  36  Non-Follow  Through  c lass rooms .     Each  class  room  value  is ,  in 
turn,  based  on  two  or  three  days  of  observation.     If  we  make  the  assump- 
tions that  the  errors  from  day  to  day  are  independent  and  normally  dis- 
tributed with  r.iean  zero  and  standard  deviation        and  if  we  assume  that 
the  distribution  of  the  Non-Follow  Through  classroom  values  that  are 
being  estimated  is  normal  with  standard  deviation  a,  then  the  distribu- 
tion of  the  estimated  Non-Follow  Through  classroom  values  will  be 
normal  with  standard  deviation 


where  n  is  the  number  of  days  observation.     Ihus,  the  variance  of  the 
est imated  Non-Follow  Through  classroom  values  will  be  greater  than 
the  variance  of  the  actual  classroom  values.     The  effect  of  the  day  to 
day  variability  is  to  make  the  first  and  second  quintile  estimates  de- 
rived from  the  estimated  classroom  values  to  be  lower  and  the  third  and 
fourth  quintile  estimates  to  be  higher  than  those  in  the  distribution 
of  the  actual  classroom  values.     The  magnitude  of  these  discrepancies, 
under  the  assumptions  made  here,  will  depend  on  the  ratio 


where  n  is  the  number  of  days  of  observation.    The  lov/er  this  ratio,  the 
less  differ(Mict  there  will  be  between  the  two  distributions.     For  the 
variables  we  have  selected  for  examination,  the  estimate  of  this  ratio 
is  less  than  .5. 


n 
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To  cissess  the  precision  of  the  quintile  estimates,  95  percent  con- 
fidence intervals  for  tne  quintiles  of  the  estimated  classroom  distribu- 
tion were  calculated. These  were  then  transformed  to  represent  inter- 
vals for  the  actual  classroom  values,  assuming  that 


a2 


is  equal  to  •5.     The  endpoints  of  these  intervals  are  displayed  in  Table 
N"l  for  each  quintile.     These  computations  were  oased  on  a  sample  size 
of  35  and  36,  which  corresponds  to  the  number  of  Non-Follow  Through 
classrooms  at  each  grade  level.     Where  the  sample  size  might  be  reduced 
because  of  missing  data,  the  intervals  would  be  slightly  longer. 


Table  N-1 

95  PERCENT  CONFIDENCE  INTERVALS  FOR  THE  QUINTILE  ESTIMATES 
EXPRESSED  IN  PERCENTILES  OF  THE  CLASSROOM  DISTRIBUTION 


Quintile  Corresponding  Confidence 

Cutpolnt  Percentile  Interval 


1  20  6-31 

2  40  22  -  61 

3  60  39  -  78 

4  80  69  -  94 


Consider  the  first  quintile  cutpoint  as  an  example  of  how  to  inter- 
pret the  confidence  interval.     If  the  experiment  of  sampling  36  class- 
rooms over  two  or  three  days  were  replicated  many  times,  then  in  95  per^- 
cent  of  the  replications  the  first  cutpoint,  that  is  supposed  to  repre- 
sent the  20th  percentile,  will  be  somewhere  between  the  6th  and  the  31st 
percentile  of  the  Non-Follow  Through  classroom  distribution. 

These  confidence  intervals  are  rather  wide,  especially  for  the  sec- 
ond and  third  quintiles.     In  terms  of  the  implementation  scores,  these 
results  indicate  that  for  a  given  Follow  Through  classroom,  the  true  im- 
plementation score  may  he  plus  or  minus  one  unit  from  tne  observed  score 
with  a  high  degree  of  confidence  when  we  ignore  the  day  to  day  variability 
of  the  Follow  Through  classroom  value.     That  is,  if  a  classroom  received 


*See  the  technical  note  at  the  end  of  this  appendix  for  a  description 
of  the  details  of  the  computations. 
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a  score  ol  lour,  Lhere  is  a  good  chance  that  the  "true"  score  might  be 
anywhere  between  three  and  five  because  of  the  variability  of  the  quin- 
tile  estim<ites»     Th.'  variability  of  the  Follow  Through  classroom  value 
would  add  to  the  width  of  this  interval,  as  we  will  see  in  Section  2» 

The  effect  of  the  day  to  day  variability  of  the  Non-Follow  Throuj^h 
classrooms  on  the  quintile  estimates  may  be  examined  by  comparing  the 
confidence  intervals  in  fable  N-1  with  those  in  Table  N-3  in  the  tech- 
nical note  at  the  end  of  this  section.     The  interval g  in  Table  N-3  are 
expressed  in  terms  of  percentiles  of  the  observed  Non-Follow  Through 
classroom  distribution;   the  intervals  in  Tah  le  N-1  are  expressed  in 
terms  of  percentiles  of  the  actual  Non^-rollow  Through  distribution, 
under  the  assumptions  of  norm/^liJy  described  earlier  in  this  section. 
As  might  be  expected,   the  intervals  for  the  first  two  quintiles,  gener- 
ally, shift  downward  from  Table  N-3  to  Table  N-1.     However,  the  shift 
is  only  slight.     We  conclude  that  the  day  to  day  variability  has  only 
a  marginal  effect  on  the  quintile  estimates  in  comparison  to  the  number 
of  classrooms  sampled 

2.      Ihe  Effect  of  the  Day-to-Day  Variability 

As  was  stated  at  the  begirning  of  this  appendix  the  effect  of  the 
day-to-day  variability  of  the  Follow-Through  Classroom  values  on  the 
implementation  scores  will  depend  on  the  location  of  the  classroom  value 
as  well  as  the  magnitude  of  the  day-to-day  variability.     To  assess  the 
stability  of  the  implementation  scores,  probability  distributions  of 
the  score  were  computed  for  selected  values  of  classroom  means  and 
standard  errors  on  selected  variables.     Each  probability  represents  the 
chance  that  a  classroom  with  a  given  classroom  value  and  with  class- 
room day-to-day  standard  deviation  will  be  assigned  a  given  implementa- 
tion score.     The  computations  were  based  on  two  assumptions: 

-    The  deviations  from  day-to-day  are  independent  and  normally 
distributed ;  and 

'Ihe  quintiles  are  given  fixed  numbers. 

Tl       second  assumption  has  the  effect  of  making  the  probabilities  con- 
litional  on  the  quintile  estimates  that  were  derived  in  the  current 
analysis.     Ihe  assumption  that  the  estimated  classroom  value  and  the 
quintile  estimates  are  both  random  is  more  realistic,  but  the  computa- 
tions become  unwieldy. 

Table  X-2  contains  the  results  of  these  computations  for  selected 
sponsors.     The  sponsors  were  selected  to  provide  a  range  of  values  for 
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Tabh  N-2 

PRO     ALlTt'  UISTKIHirriON  OF  IMPLEMENTATION  SCORES 
KOK  A  GIVEN  CLASSROOM  MEAN  AND  STANDARD  ERROR 
(I-  M'st  Gradu) 


Variable's 

Sponsor 

Cla^,s- 
rooin 
Value 

SE 

"True- 
Score" 

Probability  of  Obtaining 
Implementation  Score  of: 
12         3  4 

an 

<^ 

5 

M) .  Name* 

* 

66       Numbers,  aiath, 
ari  t hmetic 

UK 

21.3 

2.0 

4 

.00       .02       .14  ,68 

.16 

BC 

15.7 

5.5 

2 

.21       ,38       .15  .17 

.08 

HS 

19.8 

7.7 

4 

1*^          2*^          11  91 

.  «j  ^ 

67        Reading,  alphabet, 
lanj;uaj<c  develop- 

UA 

41.8 

6.8 

2 

.33       .42       .22  .02 

.01 

ment 

UO 

54.6 

5.0 

4 

.00       .05       .43  .31 

.21 

151,)     Aduli  academic 

Comm     req  .  6.  ii\  rrc  L 

BC 

7.7 

.93 

3 

.06       .11       .37  .38 

.08 

qurstions  to 
chi  Uircn 

UK 

9.8 

1.3 

5 

.00       .01       .05  .21 

.73 

*        The  estimated  quinliles  for  variable  66  are  11.2,   17.0,  19.3,  and  23.3. 
**      The  estimated  quintiles  for  variable  67  are  3a. 8,  46.4,  54.3,  and  58.6. 
The  estimated  qumtiles  for  variable  451a  are  5.2,  6.8,  7.8,  and  9.0. 
These  pro'bab 1 1 1 1  les  represent  the  chance  that  a  classroom  with  a  given 
classroom  moan  and  standard  error  will  got  any  given  Implementation 
score.     The  reliability  of  the  implementation  scores  may  be  assessed 
bv  examining  tlie  chances  of  attaining  the  "true  score." 
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Table  N-J 


lllL  VALl'I,  OF  lo  AND  ao  EXPRKSSi:!)  VA  PERCFNTI LLS 
FOR  FACH  QU INTILE  OF  NGN-FOLLOW  TiiROUGH 
(N  =  36) 


()uint  lie 

CutpC  Mlt 


Corresponding 
Po'centile 


Confidence  Level 


lo  X  "iOO    Up  X  100 


3 
4 


1 


20 
40 
60 
80 


4\ 
6b 


34 
59 
74 
90 


tile  L,lassroom  value ♦     The  within-ciassroom  .  .an  ard  deviation''^'  for  the 
selected  Set  of  CCL  and  FKO  variables        ^  *^  1 .       cOiUputcd.     The  esti- 
mates for  the  CCL  variables  were  based  ,       11  three  days  of  observation 
per  class;  the  estimates  for  the  FMO  variables  were  bSoec'  on  the  two 
days  of  adult-focus  observations.     The  unit  of  analysis  was  the  day  of 
observation.     The  es"  Imates  wer<^  computed  separately  for  each  sponsor. 
Note  that  the  estin^ates  of  day-co-day  variability  are  based  on  three  con- 
secutive days  of  observation  in  each  classroom.     The  standard  error  is 
defined  as  the  standard  deviation  divided  by  the  square  root  of  the  num- 
ber of  days  of  observation.     The  esti*nated  quirt ile  outpoints  were  *:aken 
'~rom  Table  M-i  in  Appendix  M  for  the  first  grade. 


''^If  y^j  is  the  value  of  a  given  COl  variable  on  day  j  in  class  1^  then 
the  within-class  standard  deviation  is  estimated  by: 


where  yj^  is         mean  for  classroom  i 

n  is  the  total  number  of  class  days 
B     is  the  total  number  of  classrooms 

The  definition  of  y^^  is  the  same  as  :hat  used  for  the  classrooms  exc  »pt 
that  only  COPs  for  the  given  day  are  used  in  the  computations. 
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The  figur  cs  ill  Tciblo  N— 2  indicalo  thcit^  gcncrcilly,  the  implomcntci— 
Cion  scores  will  he  within  one  point  of  their  true  value  with  a  high 
degree  of  chance*     The  exceptions  will  occur,  as  we  anticipated,  in 
those  cases  wiien  the  day-to-day  variaoility  is   Large  relative  to  the 
range  of  estimated  quintile  values  and  the  classroom  value  is  centrally 
located  in  the  Non-Follov>/  Through  distribution.     For  the  three  variables 
we  examined,   this  appears  to  be  the  exception. 

3.  Summary 

The  results  from  Section  1  indicate  that  the  day-to-day  variability 
for  the  Non-Follow  Through  classrooms  has  only  a  marginal  effect  on  the 
quintile  estimates  in  comparison  with  the  number  of  classrooms  included 
in  the  Non-Follow  Through  sample.     From  the  computations  carried  out  in 
Section  2,  it  appears  that  for  fixed  quintile  values  and  an  estimated 
classroom  value,  the  estimated  implementation  score  will  be  within  one 
of  the  true  score.     The  condition  under  which  the  implementation  scores 
are  computed  is  that  both  the  Non-Follow  Through  quintile  scores  and  the 
Follow  Through  classroom  values  are  estimated.     Under  such  conditions 
the  reliability  of  the  implementation  scores  will  be  decreased  from  both 
hypothetical  situations.     The  compound  effect  of  estimating  the  Follow 
Through  classroom  value  and  estimating  the  Non-Follow  Through  quintiles 
is  that  the  estimated  implementation  score  assigned  a  particular  Follow 
Through  classroom  may  be  different  from  the  true  score  by  as  much  as 
two  points.     In  the  worst  situation,  a  classroom  that  has  a  true  imple- 
mentation score  of  3  appears  to  have  a  substantial  chance  of  getting  an 
observed  score  on  an  individual  variable  of  from  1  to  5, 

It  will  be  necessary  in  the  assessment  of  site  implementation  and 
sponsor  expor tability  to  take  into  account  the  low  reliability  of  indi- 
vidual classroom  scores.     The  observation  of  approximately  four  class- 
rooms per  site  and  20  classrooms  per  sponsor  in  each  grade  level  does 
mitigate  the  low  reliability  of  individual  classroom  scores  since  we 
are  examining  patterns  of  scores  among  classrooms.     Also,  the  overall 

lement.   .ion  score  for  each  classroom,  defined  as  the  sum  of  the 
ScoiTes  across  implementation  variables,  will  be  much  more  reliable  th.an 
the  scores  for  each  individual  variable. 
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TECHNICAL  N^rri: 


This  note  outlines  the  derivation  of  the  confidence  interval  for 
th.'  quint ile  estimates  in  terms  of  percentiles. 

Assume  Xj  ,  X}y   ...    ,        are  independent,   identically  distributed 
continuous  random  variables  \vith  a  cumulative  distribution  function  l'(x) 
that   is  strictly  increasing. 

Let  ^^(i)>   •^(^)'   ''•'^(n)        ^^^^   corresponding  order  s'  '-t  is  tics 
i.e. 

X(^^is  the  smallest  of  X]^,    .  .  .  ,  Xj^ 

X(2)is  t,he  next  smallest,  etc. 
Lt't  ^''(^^i^   ^^^^  i  '  ^>  n  and 

Let  V(|-)be  the   ith  order  statistic  of  Yi,  Y^^ 

It  is  well  known  that: 

(1)  Yj  ,  Yj^    are  independent,  identically  distributed  random 
variables  with  a  uniform  distribution. 

(2)  Y^|^\has  a  beta  distribution  with  parameters  k  and  n-k*M  for 
eacn  value  of  k." 


|]y  referrin.L;  to  the  beta  distribution,  we  can  find  constants  1^  and 
u^^  such  that 


=  a/2  so  that 


-See  problem  10.5,  Rao,  1965. 
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Thus 


=  i  -  a 


Sinci.'  F  is  strict       incrcMsing,  this  nay  be  expressed. 


(3)  P 


-1 


-1 


1  -  a 


-I 

Dat  F     (y)   for  o  <  y  <  1  corresponds  to  the  100(y)th  percentile  of 
the  distribution  of  Xj^.     Therefore,  we  may  interpret  (3)  above  as  stat- 
ing that  with  probability  1  -  a,  the  kth  order  statistic  will  fall  be- 
tween the  100(lQ)-th  and  100(uQ)-th  percentile  of  the  distribution  of  X^, 

For  our  purpose  the  X-j^  represents  che  value  cn  a  classroom  obser- 
vation variable  for  the  ith  Non-Follow  Through  classroom.     The  parameter 
k  is  chosen  so  that  ^(]^)  is  the  estimate  of  a  quintile  cutpoint.  Then 
1q  and  Uy  may  be  found  for  1  -  a  =  .95  using  a  table  of  the  beta  or  the 
y  distribution.     For  n  =  36  the  values  of  k  for  the  four  quintile  cut- 
points  were  8,  15,  22,  and  29  respectively.     Table  N-3  contains  the 
values  of  1^  and  u^,  for  each  quintiJe. 

To  derive  the  figures  in  Table  N-1  from  those  on  Table  N-3  the  per- 
centiles of  the  distribution  of  estimated  classroom  values  are  trans- 
formed to  the  percentiles  of  the  distribution  of  the  actual  classroom 
values.     The  assumptions  are  that  the  actual  classroom  values  have  a 
normal  distribution  with  standard  deviation  a,  that  n  days  of  observa- 
tion are  made,  and  that  the  day-to-day  deviations  from  a  given  class- 
room's value  are  independently  normally  distributed  with  a  standard  de- 
viation of  (7^. 


Let  X^=  the  ath  percentile  on  the  estimated  distribution 

Z^=  the  ath  percentile  on  the  standardized  normal 

distribution  (mean  =  0,  standard  deviation  =  1) 


Then 


2  4- 


Standardizing  X^  in  terr.s  of  the  distribution  of  the  actual  class- 
room values  we  have: 


w  = 


na 


oe 


N-ll 


Foi  any  Of  on  tiu'  t'Stimaled  classroom  distribution,  we  can  find  in 
tabU'b  of  Lhc  cumulaLlvu  normal  probability  distribution,  apply  the  Lrans- 
formatioi    tor  a  given  value  of 


'€  /n 


and  Lht'ii  eonsulu  the  cumulative  normal  tables  again  to  find  the  per- 
cent iLi-  in  thv  distribution  of  the  actual  classroom  values. 
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PEARSON  CORRELATIONS 
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Appendix  P 

TEACHER  RESPONSE  TO  TRAINING  EMPHASIS,   BY  SPONSOR  AND  SITE 
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If.A(1l[:K  RISP(\\'S5  IRAIN1.\(;  FMPHASIS,   BY  SP(\\S(>R  AN'l)  SIT{ 


rh  Ks  a[>pondi\  records  f  Ladings  on  H>   items   in  Quest  ion  25  of  Llio 
leaclier  Out-st  ionna  ire ,     The  question  said:     ''How  mui.^h  emphasis  was  pkued 
upoti  each  of  these   items  during  pre-  or  in-service  training  for  your 
Leaching  assignment  this  school  year?"    The  emphasis  on  each  item  was 
rated  b^*  teachers  and  their  sponsors  as  1  =  A  great  deal,   2  =  Some,  or 
]  =  None.     The  finding:,  presented  on  the  following  pages  show  the  P<^'J/'ynt 
of  teachers  agreeing  with  their  sponsorj.     (hily  KDC  did  not  rate  the  items, 
and  is  omitted  here  for  that  reason.     The  number  of  teachers  responding 
for  the  other  sponsor  models  is  as  follows:     Far  West  39,  University  of 
Arizona   H,   Bank  Street  College  37,  Iniversity  of  Oregon  36,  University 
of  Kansas  34,  and  High/Scope  40. 

The  .terns  are  as  tolLows: 

Item  a — Helping  the    :hild  feel   important  as  a  person 
Item  b~-Developing  enthusiasm  for  learnin^^ 

Item  c — Developing  basic  skills  such  as  reading,  v^riting,  mathe- 
matics 

Iten^  d — Developing  problem  solving  and  critical  thinking 

.tern  e- -Develop  1  ng  the  child's  ability  to  work  and  play  co- 
operatively with  other  children 

Ttem  f — Helping  the  child  to  make  choices  and  become  an  inde- 
pendent learner 

Item  g--Invol  vin^^  ^-arents  in  their  child's  learnj    i  activities 
Item  h — 1  volvint,        ents  in  the  operations  of  the  school 
Item  i--I)iag'iosing  individual   learning  needs 

Item  j — Guiding  children  in  activities  appropriate  to  their  needs 

Item  k — Cooperating  effectively  with  other  adults   in  the  class- 
room 

Item  l--l\orAing  witti  small  groups  of  ciiildren 

Item  m — Arranging  the  classroom  en/ironment  for  instruction 
(placement  of  furniture,  materials,  equipment,  atid 
the  like) 

I  tern  n--Maintaining  discipline  and  control    in  the  classroom 

Item  o--Usini^  rewards  to  inf  luetic  e  pupil  behavior 

Item  it^--Developing  or  selecting  materials  to  suit  curric- 


Item  a-'-Helpin^^  the  dii Id  Fc-el   Importanl  as  a  Person 


Percent  of  Teachers 
Spotisor           Choosing  Same  Rat  ing  Rat  i  n^j; 

Kit in^  as  Sponsor   Mt\uis 


:  r  Wt  s  t 
Bt'  rkel  ey 
Duluth 
Lebanon 

Salt  Lake  City 
1  a coma 

Ail  sites 


I 


37.5% 
100.0 
75.0 
62.5 
75.0 
70.0 


2 .  OU 
1.00 
i.25 
i.50 
1.2  5 
1.40 


University  of  Arizona 
Des  Moines 
Lakewood 
Newark 
Li  nco In 
Ail  sites 


55.6/. 

55.6 

71.4 

75.0 

64.4 


1 .44 
1.56 
1.29 
1.50 
1.4  5 


Bank  Street 
Brat t leboro 
Fall  River 
New  York  City 
Philadelphia 
Tuskegee 
All  Sites 


83.3/ 

75.0 

57.1 

62.5 

62.5 

68.  1 


1,33 
1.25 
1.57 
1.38 
1.50 
1.41 


University  of  Oregon 
Kas t  St.  Louis 
New  York  City 
Racine 
Tupe lo 
Providence 
Ail  sites 


0  ;: 

50.0 
14.3 

0 

16.7 


1.33 
2.33 
1.8b 
1.13 
1.83 
1.64 


University  of  Kansas 
New  York  City 
Phi  ladeiphia 
Porta^evi lie,  Mo . 
Kansas  City.  Mo. 
Louisvi  He 
All  sites 


50. OZ 

50.0 

42.9 

37.5 

57.1 

47.5 


1.50 
1.75 
1.43 
1.63 
1  .86 
1  .65 


ERLC 


High /Scope 

Greenwood,  MlSsS. 
Ft.  Walton  Beach 
New  York  City 
Greeley 
Denv  r 

All  sites 


P-4 


15.4/ 

25.0 

40.0 

33.3 

37.5 

30,2 


1.15 
1.25 
2.20 
1.33 
]  .63 
1.4  5 


iLem  b  —  ^^^*v*-'J_^'P_j_^^jL  J^lill^A^A^irA  Learning 


Sponsor 
Rat in£_ 


Far  West 
Berkeley 
buluLh 
Lebanon 

Sail  Lake  CiL^' 
i  a  CO  ma 

Al  I  sites 

University  of  Ari  z.ona 
Oes  Moines 
Lake wood 
Newark 
Linco In 
All  si  tes 

Bank  Street 
Brat  t leboro 
Fail  River 
New  York  City 
Philadelphia' 
Tuskegee 
All  sites 

University  of  Orej>on 
Kast  St.  Louis 
New  York  City 
Racine 
Tupe  lo 
P  rov  i  dence 
All  sites 

University  ol  Kansas 
New  York  City 
Philadelphia 
Portaj^evil  le,  Mo. 
Kansas  Ci  tv  ,  Mo . 
Livii s vi  lie 
All  sites 

Hi^^h/Scope 

(j  ree nwoo d ,  Miss. 
Ft.  Walton  Beach 
New  York  City 
G reeley 
Denve  r 

All   si  iv< 


Percent  of  Teachers 
Choosing  Saint*  Rating 
 a_s_j>j,i  mi  s  o  r 


28,6; 

50.0 

25.0 

37. 5 

37.5 

35.7 


77.8/ 
77.8 
57.  1 
50.0 
65.0 


8  3.3/ 

62.5 

57.1 

50.0 

87.5 

68.1 


33.3% 
33.3 
42  .9 
25.0 
3  3.3 
33.6 


25. OZ 

12.5 

42.9 

50.0 

57.1 

37.5 


7.7/ 
12.5 
80.0 
66  .  7 
50.0 


Rat  iny 
Mi^u^s 


.50 
,  2') 

6  3 
,  i8 

56 


1.35 
1  .57 
I  .6  i 
1.42 


1.33 
1  .  38 
1.5/ 
1.50 
1.13 
1.38 


1.33 
2.33 
1.4  3 
1.25 
I.  '3  3 
1 .50 


1.25 
1.88 
1.4  I 
1.75 
1  .  S7 
1  .62 


1.08 
1.13 
1  .80 
1.67 
1.50 
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ItK^^r  L-~i'fvei<uMn^'  Basic  Skills  Such  as  Reading,  Writing,  Matiienatics 

Percent  of  Teachers 
Sponsor  Choosing  Same  Rating  Rating 

Rat  ing  as  Sponsor  ^'cans^ 


Par  West 
Berke 1 ev 
Duluth 
I  ehanc^n 

Salt  L<ike  i  itv 
All  sites 


0  7 
37.5 
87 

M.J 
37.5 
40.0 


1  .00 
K  38 
1.88 
1.  38 
1.38 
1. 41 


Iniversitv  of  Arir.ona 
Des  Moines 
Lcikewood 
Newark 
Lincoln 
All  sites 


77.87 
22,2 
7]  .4 
75.0 
61  .6 


1  .22 
1.78 
1  .29 
1  .38 
i.42 


Bank  Street 
Brat t leboro 
Fall  River 
Xev  York  Ci  ty 
Phi  lade  1 ph  ia 
Tuskegee 
All  sites 


50.0^ 

75.0 

57.1 

50.0 

75.0 

61.4 


1.30 
1.38 
1.57 
I  .50 
1.25 
1.43 


University  of  Oregon  1 


KasC  St.  Louis 

88.97 

1.22 

Xew  York  City 

83.3 

1.17 

Rac  ine 

85.7 

1  .  14 

Tupe  1'^ 

87.5 

1.13 

Providence 

100.0 

1  . 00 

All  sites 

89.1 

1.14 

University  of  Kansas 
New  York  City 
Phi  ladelphia 
Por tagev 1 1 1 e ,  Mo . 
Kansas  City,  Mo. 
Lou  isvi 1 le 
All  sites 


75.07 

57.1 

85.7 

25.0 

85.7 

65.8 


]  .25 
1  .63 
1.14 
1.75 
1.14 
1  .41 


W  iijji /Scope 
(Greenwood , 


iiss . 


Ft.  Ualton  Be<ich 
New  Yu. .    Ci tv 
Greeley 
Denver 

Al  1  sites 


30.87 

62.5 

60.0 

83.3 

62.5 

59.8 


i  .46 
1.63 
1  .6.) 
2.17 
1  .63 
1.65 
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Item  d"l)eveloping  l^rohlem  Solving  and  Critical  Thinking 


Sponsor 
Ra  t_i_ng_ 

Far  West  1 
Berkelev 
Duluth 
Lebanon 

Salt  Lake  City 
Tacoma 

All  sites 

Tniversity  of  Arizona  1 
De.s  Moines 
Lake wood 
Newark 
Linco  In 
All  sites 

Bank  Street  1 
Brat t leboro 
Fall  River 
New  York  Citv 
Philadelphia 
Tuskegee 
All  sites 

University  of  Oregon  2 
East  St.  Louis 
New  York  C-*  -y 
Racine 
Tupelo 
Providence 
All  sites 

University  of  Kansas  2 
New  York  City 
Philadel phia 
Portageville ,  Mo . 
Kansas  City,  Mo. 
Lou  isv  llle 
Al 1  si  tes 

Hi^^h/ Scope  1 
Greenwood ,  Miss . 
F't.  Wdltcn  Beach 
New  York  City 
Greeley 
Denver 

AM  sires 


Percent  of  Teachers 
Choos  i  ng  S<ime  Ra  t  i  ng  R<i  t  i  ng 
 as  Sponsor  \L^jL^^^ 


50.17  1.50 

50.1  1.50 
37.5  1.63 
75.0  1.25 
62.5  1.50 
55.0  1.48 

44.47  1.67 

22.2  1.78 
0  2,00 

75.0  1.25 

35.4  1.67 

50.07  1.50 

37.5  1,75 
42.9  1.8: 
50.0  1.50 

25.0  1.75 

41.1  1.68 

44.4  1.44 

50.0  2.17 

57.1  l.^~ 
75.0  2.00 

33.3  1.67 

52.0  1.75 

100.07  2.00 

37.5  1.88 

28.6  1.29 
12.5  2.13 

57.1  1.86 
47.1  J. 82 

69.27  1.31 

62.5  1.38 

40.0  1.60 

83.3  1.17 

87.5  1,13 

68.6  1.10 
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1 1  en  e — I)e\^o  1  op  hi^  t \w  Ch  i  1  d  '  s  Ability  to  Work^  jind  JM  a_v' 
(. oo_perat  ivc;_l  \^    llh  (Hh<.-r  GUK[r_e_n 

Percent  (n"  Teaoher^" 
Sponsor  (^hoos  ing  Same  Rat  ing 

Rating  as  ^ponsor 


Rat  ing 
Me«ins 


far-  West 
Beikeley 
Duluth 
I  t'ban. 

Sal  t  I  al:e  City 
Tacona 

All  sites 


28 . 67 

75.0 

75.0 

50.0 

71  .4 

60.0 


2.43 
2.00 
J .  00 
2 . 00 
1.71 
2.03 


I'n i  ve r s  i  t y  of  A r i  zona 
l)es  Moines 
l.aktn/ood 
Newark 
Lined  n 
Ail  sites 


55. 6Z 

33.3 

28.6 

62.5 

45.0 


1.67 
1.89 
1 .86 
1  .50 
1.73 


Bank  Street 
Bratt leboro 
Fall  River 
New  York  City 
Philadeiphia 
Tuskegee 
All  sites 


66.77 

50.0 

42.9 

50.0 

25.0 

46.9 


1.67 
1.63 
1.71 
1  .50 
2.00 
1.70 


University  of  Oregon 
Fast  St.  Fouis 
Xev  York  (M  ty 
Rac 1 ne 
i upe 1 o 
Prov  idence 
All  sites 


11  , 

66, 
57, 
0 

33, 
33. 


1.67 
2.67 
2.29 
1  .50 
2.17 
2.00 


University  of  Kansas 
New  York  Citv 
Philadelphia 
Portagev i 1 le ,  M<k 
Kansas  Uity,  Mo. 
Louisv  i 1 le 
Ail  si  tes 


50.07 
37.5 
14.3 
25.0 

/  o  g 

33.9 


1 .50 
1  .88 
1  .86 
2 . 00 
1.71 
1  .82 


H 1  gi^/ Scope 

(Greenwood,  Miss. 
Vi .  Walton  Beach 
New  York  Citv 
Gree lev 
Denver 

All  site^ 


76.97 

^2.  5 

20.0 

16.7 

37.5 

42.7 


1.23 
1  .  ]H 
2.25 
1.83 
I  .  "  > 
1  .56 
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Item  f-- Helping  the  ('hilJ 

to  Make  Choices 

and  Become 

aji_  Jnd^ependent  le 

arner 

Percent  of  Teachers 

o  p  0 1 1  o  o  r 

Choosing  Same  Ry t i ng 

Rat  ing 

R I f  i  no 

1\<JL  L  J. 

as  Sponsor 

Mea  ns 

Far  Ivest 

1 

Berkeley 

14.37 

2.29 

Duluth 

62.5 

1.38 

Lebanon 

62.5 

1  .  38 

Salt  Lake  Citv 

62,  5 

] .  38 

Tacona 

50.0 

1.63 

All  sites 

50.3 

1  .  59 

University  of  Arizona 

1 

Des  Moines 

77.87 

1.22 

Lakewood 

33.3 

2 . 00 

Newark 

57.1 

!  .A3 

Lincoln 

50,0 

1.63 

All  sites 

5A  ,6 

1 .  58 

Bank  Street 

1 

Brattleboro 

33. 3^^/ 

2.00 

Fall  River 

62.5 

1.50 

New  York  City 

A2.9 

1.57 

Philadelphia 

62.5 

1.50 

Tuskegee 

62.5 

1.  38 

Ail  sites 

52.7 

1  ,  j7 

University  of  Oregon 

2 

Last  St,  Louis 

55.67 

1.78 

New  York  Citv 

16.7 

2.50 

Racine 

71.4 

2 . 00 

Tupelo 

75.0 

1.75 

Providen^^e 

16.7 

1.83 

All  bites 

47. 1 

1 . 94 

University  of  Kansas 

2 

New  York  City 

50.07 

2.00 

Philadelphia 

50.0 

1.75 

Portagevil le,  y  ^. 

14.3 

1.43 

Kansas  City,  Mo. 

50.0 

2.00 

Louisvi  lie 

14.3 

1.43 

All  sites 

33.7 

1.71 

High/Scope 

1 

Greenwood,  Miss. 

100.07 

1 .00 

Ft.  WaUon  B.-ach 

75,0 

1.25 

New  York  City 

60 . 0 

1.40 

C^reelev 

A6.7 

1.33 

Denver 

87.5 

1 .25 

Al  1   si  tes 

77,8 

1  .20 

P- 

•9 

ERLC 

ERIC 


Percent  of  leathers 
^pon?>or  Choosing  Sane  Hating  Rating 


bar  West 
i5erkeley 
Duiuth 
I ehanon 

Salt  Take  (^itv 
Tacona 

All  site^ 


62.  5 
50.0 
50.0 
50.0 
51  .1 


1  .71 
1.65 
2.00 
1  .SO 
I  . ')() 
1  .67 


'n  i  ve r s  i  t  V  of  A r  1  zo na 
Des  Moineb 
I  a  lee  wood 
N'ewark 
Lincul n 
All  sites 


22.27 
11.1 
71  A 
25.0 
32.4 


1.78 
2.11 
1.A3 
1.88 
1  .82 


Bank  Street 
Bra tt  ieboro 
Fall  River 
N'ew  York  City 
Philadelphia 
Tuskegee 
All  sites 


50.07 

12.5 

57.1 


62, 

4:, 


2.50 
1  .63 
2.14 
2.13 
1  .88 
2.03 


I'niversity  of  Oregon 
Kast  St.  Louis 
Xew  York  O'  tv 
Rac  ine 
Tape lo 
Providence 
All  bites 


33.37 

50.0 

71.4 

37.5 

83.^ 

55.1 


]  .78 
2.17 
2.00 
1  .63 
2.17 
1.92 


L'niverbity  of  Kansas 
Xew  York  City 
Phi ladelphia 
Por tagev  i 1 1 e ,  Mo . 
Kansas  City,  Mo. 
Louisv  i 1 le 
All  sites 


:  5 . 07 

37.5 

85.7 

12.5 

42.9 

50.7 


1  .25 
1  .75 
1.14 
2.13 
1  .86 
1  .68 


\{  i  gh/Sr ope 

Greenwood,  Miss. 
Vt,  V;alron  Beat  h 
::ev;  York  Citv 
Greelev 
av^-r 

All  siL»-> 


46.27 

50.0 

40.0 

50.0 

25.0 


1  .46 
1  .SO 
2 . 60 
1  .  50 
1.75 
1  .^8 
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Item  ^^•"-"^"vj:>jvjnj£ jjirj^nj_s^^i^^^  the  Operations  of  tjie^  School 


Sponsor 
Ra_linjj 


Far  West 
Berkeley 
Duluth 
Lebanon 

Salt  Lake  City 
Tacoma 

All  sites 

Iniversity  of  Arizona 
Des  Moines 
Lakewood 
N'ewark 
Lincoln 

'  1  sitevS 


Percent  of  Teachers 
Choosing  Same  Rating 
as  Sponsor 


IS. 6' 

57.1 

62.5 

87.5 

50.0 

57.  I 


22.27 
22 . 2 
42.9 
37.5 
.2 


Rat  Lng 
Means 


2.14 
1  .57 
2.i8 
2. 1 '3 
1.50 
1.95 


1  .89 
2,n 
1  .57 
]  .75 
1.85 


Bank  ^Lreet 
Brat  t leboro 
Fall  River 
New  York  City 
Phi  lade Iphia 
Tuskegee 
All  sites 


66.7^-' 

37.5 

57.1 

37.5 

50.0 

49.8 


2.3'^ 
1  .88 
2.14 
2.  38 
2 .  Of) 
2.14 


University  of  Oregon 
East  S t .  I ouis 
New  York  C  i  v 
Rac  i  ne 
Tupe lo 
Providence 
All  si  tes 

University  o*"  Kansas 
New  York  Citv 
Phi ladephia 
Portageville,  Mo. 
Kansas  City,  Mo. 
Lou  i  sv  i  1  1  e 
.Ml  sites 

Hi  gh/Si^ope 

(Jrt'enwood  ,   Mi  So  . 
Ft .   \\d\  ton  Beach 
NVw  York  Citv 
(Greeley 
Denver 

A]  1  sitr. 


44.47 

33.3 

71.4 

12.5 

66.  7 

45.7 


25.07 

50.0 

28.6 

50.0 

'42.9 

39.3 


7.77 

0 

60.0 

0 

25.0 
18.5 


I  .89 
2,00 
2.00 
1  .38 
2.00 
1.83 


1  .75 
1  .75 
1.29 
1  .  /5 
1.43 
1  .59 


1  .69 
]  .75 
? .  60 
f  .6/ 
1  .88 
1.8:, 


P~ll 


ERLC 


Item  ^i^n< )^s_in^ J rui iv idua  1  Lear nl ng^  .^L^_^A^ 

Percen L  of  Teachers 


rercenL  oi    i  earners 
Sponsor  Choosing  Same  Rating  Rating 

Rat  i  ng^  _         Jipc)  n sor    _  n  n « 


 ^  

Far  l.Vbt  1 

Be^-keley  57.17  1.37 

Duluth  37.5  1.63 

Lebanon  25.0  1.75 

Salt  Lake  Citv  25.0  1 .88 

lacona  37.5  1.75 

All  sites  36.4  1.72 

I'niversitv  of  Arizona  1 

Des  Moines  55. 6/^  K  56 

Lakewood  1.78 

Newark  42.9  1.71 

Lincoln  37.5  2.00 

All  sites  45.1  1.76 

Bank  Street  1 

Brattleboro  66.7/'  1.33 

Fall  River  75.0  1  . 38 

New  York  Citv  42.9  1.71 

Philadelphia  50.0  1.63 

luskegee  50.0  1.50 

All  sites  56.9  1  .51 

University  of  Oregon  2 

Last  St.  Louis  22.27.  1  .44 

New  York  Ciry  33.3  2.67 

Racine  28.6  1.86 

Tupelo  37.5  1.38 

Providence                        -  33.3  1.67 

All  sites  31.0  1 .75 

University  of  Kansas  2 

New  York  City  25.07  1.25 

Philadelphia  37.5  2.13 

Portagevil le.  Mo.  14.3  1.43 

Kansas  City,  50.0  2.25 

Louisville  4  2.^)  1.4  5 

Al  1  .^i  tes  33.9  1  , 76 

Hi^h /Scope  2 

Creenwood,  Miss.  23.17  1.23 

Ft.  Walton  Bea.'h  50.0  1  .50 

New  York  Citv  75.0  2.25 

dreelev  83.3  2.17 

Denver  50.0  1.75 

All   sites  56.3  ! .64 
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Item  ^— Guiding  Children  in  Activities  Appropri^ite  Co  Their  Needs 


Fell"  WfSt 
Berkeley 
Dulutii 
Lebanon 

Salt  Lake  City 
T a CO ma 

All  sites 

L'aiversity  of  Arizona 
Des  Moines 
Lakewood 
Newark 
Lincoln 
All  sites 

Baik  Street 
Brat  tieboro 
Fal i  River 
New  York  City 
Philadelphia 
Tuskegee 
All  sites 

University  of  Oregon 
East  St.  Louis 
New  York  City 
Rac  ine 
Tupelo 
Providence 
All  si  tes 

University  of  Kansas 
New  York  City 
Philadelphia 
Portagevi 1 1 e ,  Mo , 
Kansas  City,  Mo, 
Louisvi  lie 
All  sites 

Hi  i;h/S<'opo 

Greenwood,  Miss. 
Ft,  Walton  Beach 
New  York  City 
Gree ley 
I>env<.*r 

Al  1  sites 


Sponsor 
Rat ing 

I 


Percent  of  Teachers 
Choosing  Same  Rating 
 as  Sponsor 


37.5 
37.5 
37.5 
62.5 
43.0 


5  5.6/. 

33.3 

42.9 

25.0 

39.2 


50.0;^ 

12.5 

42.9 

50.0 

37.5 

38.6 


22.2/ 

33.3 

28.6 

42.9 

16.7 

28.  / 


50.0/ 

25.0 

85.7 

25.0 

71.4 

51.4 


84.  h/ 

62.5 

25.0 

33.3 
62.5 
53.6 


Rating 
Means 


1.71 
1.63 
1.63 
1.88 
1.50 
1  .67 


1  .  56 
1.89 
1.57 
2.00 
1.  76 


50 
38 
71 
50 
38 


1.49 


2.33 
1  .  57 
1.4  3 
1.50 
1.63 


1.50 
2.00 
1.  14 
2.00 
1.29 
1  .62 


1.15 

1  .  38 
2.00 
1,67 
1  .  ^^0 
1.44 
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ERIC 


Item  k — Coopt'catin^      x e ct i ve ly  with  Other  Adults  in  the  Classroom 


Sponsor 
Rat  in g 

Far  West  2 
Berkeley 
Duluth 
Lebanon 

Salt  Lake  City 
Tacoma 

All  sites 

University  of  Arizona  I 
Des  Moines 
Lakewood 
Newark 
Lincoln 
All  sites 

Bank  Street  2 
Brat  t leboro 
Fall  River 
New  York  City 
Philadelphia 
Tuskegee 
All  sites 

University  of  Oregon  2 
East  St.  Louis 
New  York  City 
Racine 
Tupelo 
Provi  dence 
All  sites 

University  of  Kansas  1 
New  York  City 
Phi ladelphi  a 
Portagevi 11 e ,  Mo. 
Kansas  City ,  Mo . 
Louis vil le 
All  sites 

High/Scope  I 
Cireenwood ,  Miss  . 
Ft .  Walton  Beach 
New  York  City 
(ireeley 
Denver 

Al  1  siteb 

P-14 


Percent  of  Teachers 

Choosing  S^'ne  Rating  Rating 

 as  Sponsor  Means 


50.07  2,29 

37,5  2.  38 

25,0  1.75 

62.5  2.13 
75.0  1.75 

50.0  2.05 

55. 6Z 

11.1  2.44 
57.1  1.57 

0  2.38 

31.0  1.97 

16.7%  2.50 

25.0  2.25 

28.6  2.14 

37.5  1.63 
25.0  1,50 

26.6  1.97 

0  2.11 

50.0%  2.17 

28.6  1.86 

25.0  1.25 

16.7  2.17 

24.1  1.89 

25.0%  1.75 

62.5  1.50 

71.4  i.29 

37.5  2.00 

71.4  1.29 

53.6  1.56 

92.3%  1.15 

12.5  2.00 
0  2.40 
0  ..17 

25.0  2.25 

26,0  1.85 


Item  L — Working  w.  ih  Small  Groups  of  C'nlldron 


Percent  ot  Teachers 


ERIC 


Sponsor 

Choosing  Same  Rating 

Rating 

R<it  ing 

as  Sponsor 

Means 

Far  West 

I 

berkeiey 

)  Q 

2  .00 

UUi  Utii 

2.  00 

Lebanon 

3n 

.0 

1.63 

bait  I  akc  City 

50 

,  0 

1 . 50 

Tacuroa 

25 

.  0 

1.88 

All  sites 

35 

.  7 

1.79 

University  of  Arizona 

1 

Des  Moines 

DO 

.  17^ 

1.33 

Laicewood 

Q  Q 

.  / 

1 . 56 

.xcwark 

83 

0 

K43 

Lincoln 

83 

,  3 

1.6  3 

All  sites 

"7  n 
/V 

.  8 

1 .48 

Bank  Street 

Brat  tleboro 

1  r 
ID 

.  7 

1 .83 

rail  River 

1  0 

,  J) 

1  .  38 

New  York  City 

^  I 

■J 

1 .57 

Phiiadelph  ia 

25 

.0 

1 . 50 

Tuskegee 

0 

1 .00 

Ail  sites 

11 

J 

1.43 

University  of  Oregon 

i 

East  St,  Louis 

DO 

.  /^ 

1  .  33 

New  York  City 

DO 

/ 

1 .  33 

Rac  ine 

7 1 

4 

1       "7  1 

1.71 

Tupelo 

75 

0 

1.25 

Providence 

100 

0 

I  .00 

All  sites 

7  A 

U 

1.33 

Universit*    of  Kansas 

1 

New  York  City 

100 

0% 

1  .00 

Phi ladelphia 

50 

0 

1 .63 

PorLagevl lie,  Mo. 

85 

7 

1 .14 

Kansas  City,  Mo. 

25 

0 

1.75 

Luui  s vil 1 e 

71 

4 

1  .29 

All  sites 

66 

4 

1.41 

High/Scope 

1 

lUU 

O  A 

1 . 00 

Ft.  Walton  Beach 

75. 

0 

1.25 

40. 

0 

1  AO 

Greeley 

33 

3 

1.67 

Denver 

75. 

0 

1.38 

All  sites 

6'. . 

7 

1 .  JO 
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[  Lem  m--Arran>' i n ^;  Che  Classroom  Environment  for  Instruction 

(placement  of  furnituru,  materials,  equipment,  and  the  like) 

Percent  of  Teachers 
SpuDbor           Choosing  Same  Rating  Rating 
Rat  lag   as  Sponsor   '■'eans 


Far  West 
Berkeley 
:>MLuth 
Lebanon 

Salt  Lake  Cit" 
Tacoma 

All  sites 


1 


12.5 
62.5 
75.0 
25.0 
'37.9 


2 . 29 
2.00 
1.38 
1.-38 
1.88 
1.77 


University  of  Arir;ona 
Des  Moines 
l.akewood 
N'ewark 
Lincoln 
All  sites 


55.6% 
33.3 
71. A 
25.0 
A6.3 


1.56 
2.00 
1.29 
2.00 
1.73 


Bank  Street 
B  rat  tleboro 
Fail  River 
New  York  City 
Philf.delphia 
Tuskegee 
All  sites 


0 

25.0 
42. 9 
37.5 
12.5 
23.6 


2.  33 
1  .50 
1.71 
1.63 
1.13 
1.62 


University  of  Oregon 
Fast  St.  Louis 
.New  York  City 
Racine 
Tupe 1 o 
Provi  dence 
All  sites 


11.1% 
0 

14.3 
50.0 
16.7 
18.4 


2.33 
2.17 
2.29 
i  .88 
2.50 
2.  22 


University  of  Kansas 
New  York  City 
Phi ladelphi  a 
Portage  V  I  lie.  Mo . 
Kansas  City  ,  Mo . 
Louis vi 1 le 
All  sites 


50.0% 
12.5 
0 

50.0 
57.] 
33.9 


1.50 
1.63 
1  .86 
2.00 
1.57 
1.7A 


Hi  gh /Scope 

Greenwood,  Miss. 
Ft.  Walton  Beach 
New  York  City 
Gree ley 
Denve  r 

Al 1  sites 


100.0% 
87.5 
80.0 
33.  3 
75.0 
75.2 


1.00 
1.13 
1  .20 
2.17 
1  .25 
1.28 
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Item  n — >U\  Intaining  Disci  pi  in6  and  Control  in  the  Classroom 


Sponso  r 
Rat iny 


Far  West 
Berkt  ley 
Duluth 
Lebanon 

Salt  Vako  City 
Taconia 

/  II  ?ites 


Percent  of  Teachers 
Choosing  Same  Rating 
  as  Sponsor   ^ 


28.6;^ 

62.5 

62.5 

87.5 

50.0 

58.2 


Rat  ing 
Means 


1  ,63 
2.  38 
2.13 
1.75 
2.05 


Univt  roLty  of  Aiizona 
Des  Moines 
i.akewood 
Newark 
Linco In 
Ail  sites 


55.6/ 

U.l 

57.1 

50.0 

43.5 


2.00 
2.44 
2.43 
2.25 
2.27 


Bank  Street 
Brat tltooro 
Fall  River 
New  York  City 
Phi  ladelphia 
Tuskegee 
All  sites 


66.  7Z 

25.0 

57.1 

25.0 

25.0 

39.8 


2.67 
1.88 
2.57 
2.00 
1.75 
2.14 


University  of  Oregon 
East  Sc.  Louis 
New  York  City 
Racine 
TuD^ lo 
Providence 
All  sites 


44.4% 

33.3 

57.1 

50.0 

83.3 

53,6 


1.56 
1 .83 
1.71 
1.50 

1 .  r; 

1.56 


University  of  Kans  is 
New  York  City 
Philadelphia 
Portagevi  He ,  Mo . 
Kansas  City,  Mo. 
Loui  'ille 
All  sites 


75.0% 
50.0 
28.6 
75.0 

57,1 
57.  I 


1.75 
1.75 
1.57 
1.75 
I  .57 
1.6£ 


Hi  gh/Scope 

Greenwood,  Miss. 
Ft.  Walton  Beach 
New  York  City 
Greeley 
Denver 
All  sites 


23.1/ 

12,5 

60.0 

50  0 

37.5 

36.6 


.62 
.88 

60 
.50 

.13 

,03 
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[  tern  o — rsing  ^j^l^j^Jl^  ^k^l-JjlOii'^^^^^^'  Pupil  l>c>havior 


Pt_rc.ent  ot  leaelu*rs 

Sponsor 

Choosin*;  Saint*  Rating 

Hat  i  IV.. 

\\  it  1  n  l/ 

Me  a  nb 

Far  West 

BerReley 

71.4' 

2.71 

I^M  1  <  1  t  '\ 

UUl   1  L.i 

0 

2.^0 

37.5 

2.  38 

62 .  5 

2.6: 

I  a  ^  o  rna 

75  .0 

2.75 

All    Q  i  r  c 

49.  3 

2.49 

llniversiLy  of  Arizona 

2 

44  .4/ 

1  .67 

44  . 4 

2.  56 

New  a  rk 

71  4 

2.  29 

L.  1  nc  o  t  U 

50.0 

2.  50 

All       1  I  <> 

52  .6 

2.24 

Bank  Street 

i 

Brat tleboro 

_iOO.O% 

3.  00 

r ^  1  1    R 1  VP  r 

37.5 

..25 

100.0 

3.00 

rill  J-uClti  ipilici 

50.0 

2.  38 

1  Uo  K.ti  get? 

50.0 

2.  50 

All  si te 5 

67.5 

2.59 

University  of  Oregon 

1 

East  St.  Louis 

88. 9Z 

L .  11 

.New  lorK.  biL)^ 

83.3 

1.17 

Rac  i  ne 

85.  7 

1  .57 

\  i  ir>f*  1  o 

1  lip     X  u 

100.0 

1.00 

P  *"/  >  \/  1  rl    r>  /  o 

83.  3 

I.  17 

■^11  ^ites 

88.2 

1.  19 

University  of  Kansas 

1 

New  York  C.ty 

75.0% 

1 .25 

Phi  1  iritilnhi 
riixj  (.tuc^xpiixcA 

37.5 

1,88 

^or ta^e vi ) ,  Mo. 

85.  7 

1.  14 

Kanv^as  City,  Mo. 

1.  38 

bou 1 o V  L 1 1 e 

85.  7 

1.  14 

All  sites 

1 .  38 

M 1. gii /  o cope 

1.38 

Greenwood ,  Miss . 

15.4% 

Ft.  Walton  Beaeh 

37.  5 

2.25 

New  York  City 

80.0 

2.80 

Gr(?eley 

66.7 

2.50 

Denver 

5C-0 

2.38 

All  sites 

49  9 

2.  10 
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FRir 


I  ten  p-'-Devoli^piiu'  or  Se  1  tc_t  ing  Mater  ia^l  s 
to  Suit  Curriculun  Cl^juctives 


Rat  iru 


Far  West 
Be  rke ley 
baiuth 
Lebanon 

SaJt  Lake  Citv 
I a coma 

Al 1  si  tes 


Per^^ent  of  Tea^'hers 
Choosing  ^ame  Rating 
 as  Sponsor  


87.5 
75.0 
62.5 
50.0 
63.6 


Rat  ing 
Means 


1.71 
2.13 
1.75 
1.63 
1.75 
1.79 


University  of  Arizona 
Des  Moines 
Lakewood 
Newark 
Lincoln 
All  sites 


50.0% 
33.3 
28.6 
0 

28.0 


1.63 
2.00 
1.86 
2.25 
1.9A 


hank  Street 
Brat tleboro 
Fail  River 
New  York  City 
Philadelphia 
Tusk^  gee 
AH  sites 


33.  3/ 

62.5 

57.1 

25.0 

62.5 

48.0 


1.67 
1  .38 
1.7  y 
L.75 
1.50 
1.59 


University  of  Oregon 
Last  St.  Louis 
New  York  City 
Rac  ine 
Tupelo 
Providence 
All  sites 


11. rz 

33.3 
71  .4 
50.0 
50.0 
43.2 


1.56 
2.  33 
1  .71 
1.75 
1.50 
1.75 


University  of  Kansas 
New  York  City 
Philadelphia 
Porta<;jevi  1  le  ,  Mo. 
Kansas  Ci  ty ,  Mo. 
Louis  vi  He 
AH  sites 


25.0% 

50.0 

14  3 

50.0 

42.9 

36.4 


2.25 
1.75 
1.43 
1.75 
1.43 
l.b8 


High/Scope 

Greenwood,  Miss. 
Ft.  Walton  Beach 
New  York  City 
Greeley 
Denve  r 

AH  sites 


38.  5Z 

25.0 

25.0 

50.0 

37.5 

3^.2 


1.54 
1  .25 
1.7^ 
1.50 
1.63 
1.51 
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Aopend i\  0 

sP(^:;soRs'  field  skrvtcf  organization 


Inform<ition  was  r        wdilable  on  FDC , 


Append  IX  0 
SPONSORS'    HMDSrKVU'i  (M^GANIZATI^^^N^ 

Managenient  Plan  for  Far  West  Lab 

i  pen  so  r  Perbonne  1     P  n^J  ec  t  S  i  t  A^J,^M.^J1^J\^_^ 

The  relationship  between  spon^^r  personnel  and  project  bite  personnel  can 
best  be  illustrated  by  the  following  diagran.     The  sponsor  staff  works  wicii  (^r 
trains  the  Project  Directors  and  Advisors  who  are  then  responsible  for  implement- 
ing the  progrvi"^.  in  the  classroons. 

Programmatic  relationships  are  determined  by  sponsor  perceived  needs.  Pro- 
gra-^  ^talf  bt-st  suited  to  meet  the  expressed  needs  are  assigned  to  work  with  ri 
project.     Thus,   there  is  a  possibility  that  any  of  the  staff  members  may  relate 
to  any  of  the  projects. 


Responsive  Fducational  Program  Staff 


Project  Directors  and  Advisors 


District 
Administrators 


Teachers-Assistants 
Volunteers 


Parents 


Children 


FIGURE  0-1      FAR  WFST 


It 

Ini  ■rrna..i«'i.  wis  not  available  on  FDC, 

Q-3 


*tanaj^t'neiU  Plan  l.i   lin\r_^i_tv  Ari/oiui 


t  I  a^M-uoi    ui^t  riK  I  liina  1     la  t  ]  -  - C t^iu lung  asb  :  -^t  ant  s  ,   t  kWk  h^-i  s  , 
and  prograp  as.sistani. 

Parent  Liais.>n  personnel — wu^k  to  urganize,  develop,  anti  inpU 
ment  significant   parent  <utivitv  in  tlie  model. 

School  ps\\'bologist<s  and  tl^eir  aides — serve  as  consultants  to 
instructional  perbonnei  and  parents  con<.erning  learning  and 
adjustment  in  children. 

Ins t r uc  t  iona_l ,  Psycl'^ol og>>\al  Services_,_a_nd_  Paren  t  In v^ ■  1  vemen t 

-  Together  with  their  comrnunity  counterparts  (program  assistants, 
parent  coordinators  and  psychologists),  provide  the  vehicle 
for  information  transmission  among  system  components  and  the 
means  for  implementing  the  multiplier  effect. 

Travel  in  the  field  to  offer  support  awl  guidance  to  training 
implementat ion  personne 1 . 

-  Communicate  to  their  community  counterparts  the  pertinent 
research  finc'ings  that  have  bee**  tested  and  demonstrated  on 

a  lim.ited  scale  within  program  classrooms  at  Ochoa  Elementary 
School. 

-  Communicate  back  to  the  Center  questions  from  the  field  that 
generate  testable  hypotheses  for  research  or  that  indicate  a 
need  for  further  development  and  explication  of  the  model. 
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rhf  Bank  Street  \ield  organization  may  varv  at  ea<.  h  site  in  order  tc  rwij' 
the  needs  of  tne  lonruni^tv.     However,    in  each  site  tiiere  is  <i  Field  Repi  esent  a  I  i  ve 

'   1^  t  tu   V  vr,ve\or  v'!    ttA   hanr   Mr^et  Puidel    to  tlie  ^onriunity.      Ihe  res|n)n^  i      i  i - 
tie-  ^■f  the  Field  Representative  are  to  plan  with  the  Dire.^cor  of  the  Folhn; 
Ihroagt;  program,  coordinate  witli  the  Stafi  Developers  and  conmunicate  with  tiie 
connunit\,   the  school  department  personnel,  the  principal,  and  the  parents.  Ihe 
Field  Repr*  sent<i t ive  right  be  a  local   person  or  a  person  from  Bank  Street. 

'  UT'   also  are  Staff  Developers  who  are   loeally  based,  but  trained  a.  Bank 
Stre*.  I.     Itif  resronsibi  1  ity  of  the  Staff  Developer  is  to  conduct  on-site  training. 
The  n-imber  of  Staff  Developers  at  a  site  depends  upon  the  number  ot  classrooms 
theie  aic   to  supervise.     There   is  a  ratio  of  ten  i.  lassrooms  to  one  Staff  Developer. 

In  sofk^  .^ices  there  are  resource  people  who  may  specialize  in  reading  math, 
iri,       leme,  or  soLial  studies.     Their  expertise  is  called  for  by  either  teat  iiers 
or  the  staff  developed-  as  they  are  needed. 


'J 

r 

7 

"J 

2 

I 

r, 

2 

I' 

% 

I 

i 


3 


Q-7 


ERIC 


1.      Manager  Coordinator 

"iiMain  l.etAetn  t\w  prui^nt  r'anagt-r^^,  ^  onsLi  1 1  aiU , 

pro;evt  '!  I  rt'i  t  tT*^ ,  and  lure^'tor  for  .^dninihtr^it  ion  dml  Rc-'sea.rUi 
aaa  Dirt^tor  tor  i'ro^rar  aiui  Iralning. 

^.!lOviuK'  trsiining  nt.-LHin,;s,  prfscribt?  and  receive  ana  t-dit  bi- 
r^onthlv  nanager  reports. 

Rev  LOW  .lata  f  ron  sites  and  take  corre<.'tive  actior  where  needed 
or  ^onrunuate  problers  to  Director  fo^  A  &  R,  handle  telephc>ne 
and  written  •  or.r.uni;'at  I'o^^  witli  their  sites,  trouble  shoot  pr()b- 
ler.s  L-r  reler  then  tv>  euier  Director  as  nc-eded . 

keep  D  ire o  tors  mf orned  of  the  status  of  the  field  ope rat  ion . 

Responsible  for  the  efftoti.e  and  coordinated  functioning  of 
their  projects. 

Help  dei ign  classroom  routines,  training  sessions  (pre-  and 
inservice),  and  staff  atllization. 

ReceiVf  copies  of  all  local  data  reports  prior  to  computer 
analysis  and  are  responsible  for  regrouping  children,  changing 
classroom  procedures  or  instituting  special  workshops. 

V.'ork  closely  with  field  supervisors  or  local  teacher  super- 
visors and  nonitor  their  activities. 

Rev lev;  directly  half  of  the  videotapes  being  sent  from  the 
sites. 

foiKluct  on-site  evaluations  of  problems  and  prepare  solutions, 
and  send   in  nonthlv  reports        process  of  their  sites. 

Participate  in  program  review  sessions  with  Director  for  A  &  R 
and  assist  in  training  workshops  for  local  teacher  supervisors 
and  for  teachers  and  aides. 

3 .       \'  1  d  e . J  t  a  D  e  ^1 U)  p 

Review  v uJL^otapt-s  iron  sites  as  prescribed. 

Prepare  f ee  lhack  reports  on  site  problerus  to  nanager  coordi- 
nators. 

\ .       Sj-^:  r  e  t  a  r  >' 

^%inasi»»rient  rc-i^or  ts  ,  site  correspondence  ,  manuscr  Ipts  . 
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Ma n agenen t  IMan  J o r  [ i v e r s_ i jlv^  oJ_ t n_^a s 
I .      n 1 ^  t  r  u  t  Adv I  S or 

vp>)ru->>./r  I  t'Pi  c^t'iit.ii  i\f  I)   Unal  vunrnjiuty  in  eiiarv;^  of  l  rain- 
ing and  trouble  s!Ku)Cing. 

People  at  other  universities  (near  sites)  who  have  worked  with 
the  nodel. 

^  *      Program  1  )Jrector/S  tjj  f_  JIj- aj  no r  / p a r e n  t^  T r a i ne r 

1  raining  and  demons t ra t  Lon  in  elabsroomb,  one  at  each,  class 
level,  praoticun  work  for  all  teachers,  teacher  aides,  and 
parents . 


g-iO 


< 


O 


I 


0-1  1 


(oorJinatt*  the  iun>;~rangt'  rt'st^cir^h  .uul  dt^vo  lopneiU  work  ot  1(1- 
low  Tnrou^h  sl.jt  f  . 

-  'lonitor  the  deve  1  opnuiU  ot  reports  and  pr^^posals, 

-  Assist  Willi  the  clKu>reti(al  Jevelopnent  of  the  Cognitivelv 
Or  1  en ted  Curriculum. 

1.       Field  S L rv^ i_c e s  J_Ai or d_i n a t u r_s  for _f >^ilv£r__ai^i_Yj)^ 

Deliver  adn in  is t rat ive  service  to  local  sites  (one  week  per 
pro'] ere  —  {\ist  and  uest)  . 

-  loordinate  w'ork  on  adni  n  ist  rator  '  s  guide  and  Parent  Program, 

(^ordinate  the  work  of  support  personnel   in  other  departments 
with  harly  Llementarv  Department. 

(coordinate  the  deiiverv  of  field  services  by  field  consul tants» 

-  Coordinate  the  production  of  year-end  and  progress  reports. 
Answer  Foundation  correspondence  related  to  KoUow  Through. 
Coordinate  development  of  evaluation  documents. 

3 .      Re se arch  Dire c t or_ 

-  Coordinates  and  directs  research  and  evaluation  activities  of 
research  associate,   research  assistants  an^*  research  support 
staff. 

-  Coordinates  the  development,  analysis  and  interpretai Ion  of 
Productive  Language,  Mathematics  and  Classroom  Observation 
Instruments , 

-  Responsible  for  research  reports  included  in  all  reports  to 
local  sites  <ind  N'ational  office, 

-  Responsible  for  overall  evaluation  design  and  analysis  plans 
fot  Follow  Through, 

rra  ining  and  Deyelopment  ('oord  i  nator 

-  Provide  overall  coordination  of   in-house  training  for  Founda- 
tion ^taff  and  training  at  sponsor  site  of  local  project  staff, 

-  C(M)rdinate  the  production  of  curriculum  training  materials  and 
the  development  of  the  training  system. 

~    Coordinate  evaluation  o'  training  at  the  sponsor's  site, 

-  Assist   in  the  revision  and  interpretation  of  langua<^e,  math, 
and  ohservai ion  instrument  s . 


1 


^ •      iM.eld  Staff  (Field  Consul tants  and  Program  Consultants) 

-  Revision  of  training  materials,  procedures,  and  evaluation  in 
the  field  and  at  the  sponsor's  site  are  primary  responsihil it Les 
of  the  field  staff.     This  involves  developing  training  objec- 
tives, strategies  and  materials  and  procedures  for  assessment 

of  Leacher  and  CA  competencies. 

-  Provide  training  for  local  site  staff  during  October,  February, 
and  May  workshops  at  the  sponsor's  site. 

-  Responsible  for  supervising  the  on-site  application  of  training 
procedures . 

-  Provide  four  weeks  of  field  service  for  each  of  two  projects 
under  their  direct  supervision. 

-  Provide  written  field  service  reports  which  document  services 
and  serve  as  a  working  guide  Co  further  program  implementation. 

-  Train  project  personnel  according  to  specific  needs  identified 
by  the  project  and  the  Foundation. 

6 .  Research  Associate 

-  Analyze  cata  from  Follow  Through  centers. 

-  Proposes  and  conducts  pilot  projects. 

-  Participates  in  planning  with  Follow  Through  service  staff. 

-  Writes  research  reports. 

7.  Research  Assistant 

-  Serve  as  liaison  between  Follow  Through  research  and  service 
components . 

-  Participate  in  Follow  Through  planning. 

-  Make  arrangements  for  data  collection  and  coding. 

-  Propose  and  conduct  pilot  projects. 

-  Participate  in  report  writing. 

8.  Data  Processor 

Coordinate  and  record  incoming  data. 

Score  and  keypuacl^  data. 

Set  up  and  type  coding  manuals. 

-  Maintain  data  files. 

9.  Media  Specialist 

-  Provide  responsive,  effective,  and  reliable  med'a  services  for 
the  design,  development,  and  production  of  educational  media 
for  projects  and  operations. 

-  Puichases,  controls,  and  maintains  media  materials,  equipment, 
and  products. 

Q-13 


1 0 .  (;_raj>iuc  ;\r  Lj_s_t 

-  Designs  and  produces  graphic  materials  (titles,  drawings,  charts, 
graphs,  posters,  etc.)  for  videotaping,  33mm  still  photography, 
8mm  and  16mm  motion  picture  photography,  overhead  transparency 
production  and  displays  for  workshops,  practicums,  etc. 

-  /Xssists  in  layout  of  graphic  production  for  print  media  (reports, 
brochures ,  tra ining  manual s ,  books ,  etc . ) . 

11.  Tra  j  n  i  ng  Sped  alls  t  s 

Develop  and  execute  training  procedures  to  be  tested  and  imple- 
mented at  TDC  training  workshops. 

Provide  field  service  to  establish  demonstration  classrooms  on 
site. 

Work  with  training  assistants  to  plan  and  execute  training  work- 
shops dt  the  TDC. 

Work  closely  with  consultants  in  the  evaluation  and  revision  of 
training  materials. 

12 .  Producer /pi rector 

-  Assists  field  staff  in  the  formulation  and  design  of  teacher, 
CA,  training  material. 

Responsible  for  production  and  dissemination  of  audiovisual 
training  materials. 

Assists  in  design  of  training  activities  in  which  audiovisual 
materials  are  used. 

13 .  Training  Assistants 

Work  with  training  specialists  in  the  development  and  implemen- 
tation of  training  procedures. 

Provide  feedback  on  teacher  and  CA  training  materials  during 
training  workshops. 

Implement  experimental  curriculum  ideas  with  children  in  TDC. 
Head  Secretary 

C         nates  activities  of  director,  coordinators  and  field 
s      .  within  the  group  and  with  other  departments  of  the 
Foundation. 

Coordinates  written  production  for  training  workshops. 

Asi-nsts  in  preparing  reports  to  centers,  SRI,  and  the  federal 
governmen  t . 

Processes  all  requests  for  materials,  supplies,  media,  and 
office  equipment  through  proper  channels  Co  attain  desired 
results . 

-  Conducts  debriefing  meetings  with  staff  who  have  returned  from 
field  visits  and  transmit  relevant  information  to  ihem. 

Trains  and  supervises  clerk-typist  in  department  operations. 

Q-14 


^  ^  '  ^  g  ^ / C 1 e  r  k-Typ  i  s  t 

-  Type,  duplicate,  and  distribute  all  written  materials. 
Record  and  prepare  minutes  of  departmental  meetings. 

-  Maintains  files,  records,  supplies,  and  resource  library. 
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Appendix  R 


MEANS  AND  STANDARD  DEVIATIONS  ON  VARIABLES  USED 
IN  DISCRIMINANT  ANALYSIS 


'             ^A^.-*-,-*  ..V**,*"  S*est        /AAtL^il^^  Street      .SLS^^BB^^  Hlgh/beopt-  H)( 

^"r?«J    .Vr5   ...     ''e^p  VP.-.  S  p MejanJ    S\d\     M^^n"    ^.P.      M7an'"'f.D"     MVaV  SJ)"; 


'^3       St'^rv,  ausK  ,  jam  iig 
Arts,  ir^ifts 

t:u<»s»lng  gases,  .dble  gjrc.». 
♦>0        Nurt>t-rs.  ■aar'-i.  .tritnrftl. 

tH       Social  itadies.  ^eogr^phv 
69       biienic,  natural  -?orld 
7-       D^'aadti^.  pUv.  drosjj-up 
452       v'drletv  ot  activities,  u^^n- 
v^urrent 

S3         viTieiv  ot  j^tlvlti«?s. 

H>       TtJ>.^er  wiiho^^i  .hildrc" 
«♦>       Tedvner  virh  on«  s.hlld 

Te«K  her  with  two  tMldrtri 
drt        Irji  hc-r  wltn  saali  gr  <up 

7f!A^neT  with  Urgf  group 
91        Aide  without  ^hildr»^n 
9:        Aide  with  one  ■  hlld 

Alle  with  saali  group 
^'       AiJ^  with  large  gr.^up 
i'J^        Mit*  .hlld  wltn  dnv  idult 
ill        >nall  j;r>up  of  .hUdren  wlf, 

JRv  adult 

*)nf     *Uld   ilidf pfldfPt 

i'"^        All    hildrea  Independent 
122        iaali  group  wltr  (father  ' 
Math 

12  i        Urgf  gr.mp  vnn  te^j^  her 
Math 

lib        Saali  gruup  vltt'  aide/ 
Math 

127        Urge  group  with  aide/Math 
Fersonallzcd  In'itruot ion  in 
Math 

1^2       All    hildrer.  hjdependent  ' 
Math 

■.i5        S-Jiall  group  wiih  teacher' 
Sead 'ng 

U6        Urg-»  group  with  ceath*;r/ 
Reading 

1-  i**        *^mall  group  with  aide/ 

Peadlng 

150        Largf  group  with  ald^;' 
Reading 

16-*        PersonaliztJ  ln$trntl.>n  ii 
t<ead  Ing 

1^5        All  'hlMren  Independt^nt ,' 
RtMdlng 

229        reai.her  lnvalved/tlassryoc5 

Management 
2  JO       Aide  Invulvcd/i^IaHHroi^n 

Managetaent 
231        Volunteer  lnvolvLNj/(  l  jssroois 

Manageraent 
2  32        AiiJong  adult s/Sol  1.^1  Inter- 

ai t  Ion 

2i3       A^iong  aduU-*  and  <    '  niivn' 

s  1'  lai  Intera<  ;  i.^n 
23^       Asong  children/Sot  la!  Inttr- 

A'^  t  Ion 

23^        Math  or  >»k  len^e  tqulp"itnj 
A;.  AderiK  A^  1 1  vrlti^s 

2-  4  •        Iext«..  -f.ir>i,h.)oi<s  rt>^  a  ior  I 

\*  tlvit  K" 

A  tiv'itles 


2.13 

7  ^j, 

1  u 

7.9A 

4 

n 

1.73 

5.69 

1 

.  30 

7 . 39 

1 

.91 

7  .2f> 

.93 

)  79 

8  76 

7.79 

,8  40 

8 .  2^ 

1.81 

2.22 

4 

.16 

i 

•  '>} 

6  02 

5 

31 

8.1-4 

7 . 54 

8.87 

5  .05 

8.67 

5.52 

'7.07 

4 .  ?7 

2 

76 

3.65 

2.80 

2 

.67 

7  .20 

5 

11 

8.86 

6.  a9 

1.3^ 

2  09 

2  6^ 

2.06 

17 

.45 

1 

.44 

1 

.05 

2.28 

3 

28 

1.54 

2.08 

1..  3  3 

5  73 

1  3.61 

i  80 

15.57 

9.73 

27 

03 

8.53 

21 

.90 

3 

.13 

19.66 

12 

.11 

13.56 

6  49 

)9  3-- 

1  r  v." 

^39:55 

U.Oi 

54 

37 

6.69 

59 

33 

8 

94 

39  96 

13 

.73 

28.78 

14.84 

2  :9 

2.9V 

2  51 

•*  96 

.97 

1.76 

2 

26 

i.52 

1.94 

2 

69 

1.30 

3 

.21 

1.44 

3.25 

2.62 

3.60 

5  31 

4.54 

32 

.51 

2 

53 

3 

43 

2.27 

3 

.16 

4.85 

4.49 

i.53 

.76 

1.7: 

.71 

1  -8 

47 

1.47 

54 

I 

^^ 

,53 

.67 

2.28 

2.90 

2  09 

.^3 

2  37 

62 

l.9it 

.62 

1. 

69 

,28 

1 

99 

27 

2.17 

.61 

2.40 

.87 

7.  i3 

1 .  35 

7.30 

2  11 

7.05 

1.63 

4  . 

48 

1  57 

5 

65 

1 

50 

7  07 

I 

.63 

8.37 

1.91 

13.  3i 

9,66 

12.65 

7.6<i 

1  3.64 

9.  70 

9. 

14 

6.26 

9 

43 

17 

00 

8.97 

10 

43 

18. U 

8.73 

17.80 

lU  ^7 

K  99 

16.^1 

12.83 

16.71 

2. 

47 

5.19 

2 

73 

6 

97 

9  72 

S.92 

16  44 

12.77 

6.9} 

6.17 

38 

4  08 

3.01 

2. 

16 

2.69 

3! 

89 

3.8a 

4.56 

5. 32 

4  70 

25.63 

39.79 

16.82 

35.27 

12.05 

52. 

54 

16.44 

64 

06 

23 

52 

56.27 

18 

.52 

26.93 

15.65 

36  3  3 

10.85 

28.19 

13  24 

33.82 

13.12 

33, 

71 

20.45 

23 

£*8 

21 

99 

21.20 

33.18 

13.6' 

28.76 

10,03 

33. 6i 

i;.23 

3i.80 

25.89 

26. 

53 

14.40 

U 

86 

11 

70 

24.78 

18.09 

48.89 

kH.36 

2s . '  > 

2  3.96 

6.20 

•i.59 

7.33 

6.94 

4. 

20 

4.68 

I 

56 

2 

38 

7.00 

40 

n  5t) 

1  )  16 

27.10 

21  ,78 

50  57 

U.85 

<il.23 

27.44 

56. 

02 

19.80 

69 

98 

24 

98 

53.17 

22 

12 

18. 05 

17.48 

9.^,6 

9.15 

5.9? 

6  00 

11,69 

12.82 

12. 

12.32 

13 

03 

15 

57 

9. 36 

9.87 

1  }  4h 

10  y> 

3  Vi 

1.91 

:  38 

l.u4 

1.31 

1.12 

4f) 

.38 

73 

1. 

02 

1,37 

1 

23 

1, 87 

1 .51 

16.  18 
7  31 
J9 . 

10  93 
3  ^(> 

11  62 

28.02 
4.C2 
34.92 

10.14 

3  36 
12.84 

26.18 

5,30 
33.80 

15.22 
2.56 
7.61 

37.84 
2-41 
22.20 

15.55 
3.75 
8.22 

62.55 
.73 
5.59 

26 
3 

.59 
.79 
.82 

45.  7 
4.10 
23.11 

22  1^ 
3.63 
12  45 

14.48 
7.01 
42  I  J 

6.37 
5.05 
10.58 

6.  10 

5  05 

1 1  .<»5 

18.64 

10.14 

10.  36 

10.12 

17.45 

7.89 

24 

.37 

32.42 

23.11 

1 3.28 

n.09 

19.08 

17.20 

5  06 

10.07 

17.77 

18  85 

18.46 

18.84 

2.87 

b 

.77 

7.93 

16.02 

15.43 

2^.64 

20.52 
2.01 

26.1s 
5.57 

38  58 
.19 

30  07 
90 

21.63 
7.37 

24.72 
9.83 

40,05 
11.26 

28.88 
14.10 

63.52 
22.73 

34 
29 

.03 
.53 

30.29 
3.61 

25.67 
7.89 

^.1  . 

2.03 

7.7> 
8.83 

6.9: 

5.23 

2  6. 

3.26 

4,  31 

5.40 

.47 

.52 

.79 

.95 

3,15 

4.29 

6.  31 

7.05 

42  9  3 

27. «8 

35.10 

24  b) 

37,  J7 

27.69 

19.66 

12.93 

1.47 

2 

,09 

18.52 

19.04 

51.77 

25.60 

9,9'> 

7.60 

19.77 

11.62 

15  16 

7.11 

19. o2 

12.86 

24.09 

8 

.52 

26  87 

16  32 

13  09 

11.84 

22.25 

13.04 

12  28 

14,91 

16.8^ 

12.73 

22 . 10 

16.72 

14.73 

18 

.37 

P. 61 

16  J2 

16.60 

13.90 

5.64 

5.  55 

1  3.56 

10  33 

20.5b 

17.43 

25.13 

17.23 

z7,l2 

28 

10 

22.46 

17.47 

4.40 

5.98 

^  14 

6.09 

3,5C. 

7.15 

1.89 

i.45 

9.12 

8.9; 

4  83 

7 

98 

5.82 

7.28 

6.39 

9. 38 

6.59 

4.  n 

2  99 

3.6l 

3.58 

69 

.67 

1,25 

1 

25 

3.84 

3.38 

7.9; 

8.34 

45.  36 

12.12 

40.41 

17  47 

40,74 

16.09 

22,98 

1  3.70 

3  26 

3 

53 

18.04 

13.41 

45.26 

15. 2f 

lO  b-* 

9.02 

8.76 

7  3^ 

6.81 

...61 

5.57 

6.17 

3,57 

3 

51 

0.24 

5  88 

13.55 

8.14 

1  i.^h 

9.42 

20.  «2 

10. 4« 

13  52 

15,  38 

17.0.4 

9.95 

7.87 

6 

40 

17.57 

17,31 

27.47 

15.  IH 

2.85 

6  m 

5.19 

8,Qj 

1  90 

5.62 

.19 

.57 

4.73 

5 

45 

5.99 

10.93 

10  49 

\* 

70 

1  20 

■46 

1.58 

1  05 

2.35 

.  35 

1.53 

.94 

2. 

58 

1.49 

4.10 

1.16 

1.61 

6 ,  .*H 

I  .  M 

1  50 

3.30 

6^ 

1  .f  4 

.63 

I. 

48 

3.09 

7.60 

2.98 

4.29 

-.'^^ 

7.2) 

\  tl 

2.0  J 

70 

1  .91 

.10 

42 

.37 

.91 

7.83 

6.32 

:  2 . 7 . 

15  27 

i»,9*J 

^1  26 

i.40 

2.44 

40  56 

37 

36 

26.63 

21.97 

23.49 

25.  '.0 

M  »: 

5 » .  )0 

33.98 

55  69 

50.51 

81.  2^^ 

11.48 

86.11 

14, 

38 

57.70 

2'. 43 

56,59 

22.21 

16  ^1 

11  ?3 

16.00 

1  .82 

}  0.- 

1.67 

3. 

91 

18.79 

24.19 

17.  *8 

15. hi 

R-3 


ERIC 


lnivor>it\ 


I  in 


s  f> 


Art^.  V  rat t-* 


7.58 


6.  J9 


^TviIJ  group  ^Itn  tt.i  her/ 
Math 

Large  group  \miz^  ttjiihcr/ 

Sraall  gr  -up  wtt'i  iiU' 

',arge  gr  'u;>  with  / 

Fer%ondli2oa  mstruv  c  ii>n  tn 
Math 

All  ihi;<jlr«"n  ifult  pvnJcnt  / 
Matt. 

Sfftjll  group  with  tier/ 
Ko  jij  ing 

A  drgt*  gr.)iip  i«Ut  ^t-ai'ifr' 
HfjJlng 

Sr4il  grou.>  wUt  .ijJe 
R'Md  Ing 

i.irgt  group  uiii,  iti*-/ 
RtHdlng 

KcfHon.ii  i^t.J  instru.  ti  n  in 
H;«a.}lng 

I*  ithtr   Involv  1 '!  tas-jroni^ 
Ma'"age"*ent 

Ai'Jc  involvtvi'   lH[N^.r  H - 
^l,*nag. 

"a'^agf^i  til 

r>g  ^du^'^/s..   Ul  Ith»>! 

'>'H  j^I  InJi^r^i.  ;  i  i 

•\r.>ng    .iilfJrtn''^     iil  I'^'t"- 

i  .f^.    ..;r^^«  \    Oj.-  I 

gi-..>  A  iS'rt 
\   M    it  I.  -i 


22  n 


H.99 
J.  .21 

16  77 

9  00 


14   1  5 
I  . 


'^2 


2^.75 
11.41 

26. 8K 
J  .01 
;.27 

19.  K 
16  b-4 
^  12 
2.66 
J7.62 


25.68 

27.41 
2.82 

:.9i 
16. 3i 

10  '>0 

I  5  ^0 
/^.68 
^.26 

19.23 
6.07 

n 


1  J  7 

: ) .  Q  7 
' ; .  2  H 


1.*  75 
}0.51 

9.31 
10.34 

-'.S6 

i5  a' 

16.07 
7.2') 

ijn 

30.03 
0.06 


'^7 

9 .  OH 

'■)2  .  7H 


puzzlt  s 

1 

2  89 

3. 

10 

1  03 

1  21 

.53 

Nus-bt-rH.  ".at  .   »r It' fct  1. 

i: 

15 

19.56 

6  31 

27.40 

Reading,  alyu^t-t,  Li'iguagv 

^0 

,  3t- 

U.72 

41.69 

12 

19 

37. 5S 

U  85 

57.60 

6S 

boi  IjI  <«ludlv'«.  vi'^grj;'*". 

.1  ) 

$  20 

2.«6 

94 

8  92 

2.80 

^9 

S-ion.  0.  nt  iral  «ori  j 

M> 

b.  48 

6. 

4  j 

3.87 

5.24 

2.59 

72 

L'r.i-54ti^   pla>.  <Jr»'.>-up 

1.  J7 

.28 

79 

.03 

10 

.27 

'w  irietv   )t  a«. t  svit ttf^. ,  ^in- 

t  urront 

\ 

2.21 

59 

1  .52 

.26 

1.49 

H  J 

.irtetv   »{  41  I IV 1 1 i^T'v ,  x)vt'' 

■  >n»  'li. 

IH 

7.01 

56 

6.  37 

1.35 

3  '■>7 

S'» 

I*-a  '  K-r  wltho.^c  vKilJren 

16 

lf»  3* 

I J  59 

9 

03 

9.90 

6.51 

15  19 

rc«».  tier  with  one  MlJ 

17 

.98 

11.89 

8.42 

S 

/5 

9.13 

8.75 

4.9*i 

S' 

n^-r  wit'i  two  ^^^ildr*'^ 

s.  78 

3  70 

92 

4.87 

6.08 

2.<»5 

H« 

'fj'fiti  wit^i  'juiail  grokjp 

7  5 

I  3  i)r> 

4-*.  U 

15 

90 

36-23 

17.55 

28  60 

49 

I*-4vh«r  witli  I'lrge  gro'ip 

<t. 

U3 

1  }.07 

29  98 

87 

39.87 

17  59 

48  31 

^1 

A. sit;  wjtfjout  fuldrcn 

39 

20.58 

2". 28 

16 

9t> 

30.50 

14.63 

33.04 

**2 

Aide  Wit  '   jne  (.hUd 

12 

.71 

10  f>5 

5  67 

61 

t).82 

8  98 

5.39 

A»d»  JittJ  ^^11  group 

27 

«il 

Ib.l  J 

56.56 

17 

37 

<.2.71 

19.54 

35.01 

9j 

Aide  with  large  gr,>'ip 

1 1 

n-:>n 

b  S.I 

5 

52 

13  86 

12.  U 

23.15 

I  -.^ 

On^  .  hUd  with  anv  adult 
Ssall  group  of  chUdrt*n  with 

1,4  J 

.9J 

92 

1.07 

1.20 

.66 

any  idt.lt 

12 

6.86 

J2.2  3 

U 

95 

24.63 

15.50 

19.90 

lU 

»JPe  t^hilj  ind«;pcnoio'nt 

.70 

i.63 

3.  3i 

3 

03 

3.60 

3.82 

1.45 

1  \!i 

All  ■^ildr<'n  indt*pi"id«  nt 

^1 

.  4h 

9.4  J 

i2.5  7 

1 ) 

32 

26.96 

12.18 

30  95 

9.32 
27.95 
10.89 
13.18 

3  50 
22.55 

9.20 
20  .0 
12  U6 

9.71 

4  74 
16  46 

5  26 

S  62 
1. 00 
1.60 

1  ^^ 

11  71 

26,  ;i 
n  1  > 


4.40 
31.16 
23  39 
iG,K7 

1.69 
27.99 
11.20 
16.08 

7.08 
10.85 

!  .24 
32  89 
10  42 
19  J2 

;  ""^i 

0  00 

1 .  >1 

1  *.9 
7h  i9 

19 


1 .86 
2.35 


.97 

7.62 

11.24 
5.58 
5.07 
.8b 

.23 

I.  1^^ 
1 3.  20 

7.1 1 

4.24 
20.13 
2'.  50 
2i.2f) 

6.06 
20.45 
21.29 
.02 

i3.  30 
I  40 
13.64 

7.51 
35.02 
24.  79 
11.00 

i.85 
20  72 

K.88 
23.  J4 

8.10 
15.43 

1.25 
1 7  .  i  7 
I'..  >1 
5^ 

J.  12 

O.OO 

3.24 
12.21 


.  20 

1.15 

4  ."i^*^ 

J ,  ()1 

*> .  4 , 

I 

9^ 

2  J6 

'••.17 

2  48 

3."  } 

J  8 

3 

68 

1  . 55 

2  . 50 

4.^8 

.  5  3 

6  .80 

S 

)5 

1 .  16 

1  63 

1.50 

1.43 

1  .4  J 

1 

70 

21.92 

4 .63 

16.17 

8.  38 

0-« 

58 .  79 

10.04 

'.5.77 

10.  79 

37,05 

1] 

36 

4.79 

4.40 

2  2i 

4.16 

1 ,48 

> 

89 

1  .4-^ 

2.  30 

^.67 

6.  17 

3.60 

J 

07 

.05 

.17 

J6 

.71 

.29 

61 

1  .83 

.27 

1.9) 

56 

1  8S 

56 

4.67 

1  .b2 

6.56 

1.59 

6.55 

I 

72 

6.  16 

6.89 

iO.37 

12.  16 

19,74 

15 

39 

2.05 

3.25 

8.66 

U  .78 

14  7  i 

15 

14 

.65 

1. 18 

2.83 

3.55 

3,89 

49.51 

32  22 

50  87 

23.97 

32.15 

13 

76 

41.63 

iC.24 

27.28 

17.82 

29.48 

18 

04 

13.31 

11.53 

24.29 

16.15 

40.^5 

18 

70 

l.jO 

1 .87 

9.85 

10.98 

8.  36 

8 

U 

61 .72 

29.93 

48.79 

19.74 

29  08 

1  ) 

06 

22  .5<» 

24.90 

12.59 

13.  54 

16.  .1 

->  J 

.fjO 

.  36 

.44 

1.30 

1.35 

1  30 

1 

02 

45.81 

3  3.28 

37,  74 

18. '4 

15  65 

6 

71 

1.9'. 

2.20 

3.80 

^.9  3 

J4 

3 

.37 

10.61 

10.89 

25.40 

12.51 

45.  36 

21 

.  <0 

1  .19 

1.87 

20.06 

21.72 

12. 5u 

1  \ 

.33 

14.  15 

26.53 

15.27 

18.46 

26.40 

28 

9« 

54.  14 

40.08 

18.12 

17.58 

7.90 

6 

.34 

19.  59 

2  7  80 

5.56 

11 .86 

5.7 

V) 

25 

I  .  H 

2  02 

3.60 

5.  13 

!  .91 

I 

'48 

8.  12 

1  1.82 

29  83 

23.99 

4  3.  30 

27 

32 

18.05 

1  3.42 

18.15 

12.  32 

11.13 

8 

25 

20.  31 

18.41 

18.85 

13.80 

22. C. 

16 

13 

34.  2H 

25.68 

21.43 

16.48 

10.57 

6 

86 

1  K79 

17.57 

8.42 

10. 12 

6.46 

6 

97 

.51 

.79 

2.45 

2.58 

3.62 

i 

S3 

h.63 

11  56 

24.48 

13.90 

4t.00 

77 

4.62 

7.95 

6.20 

M.06 

U.b2 

10.89 

1 1 .81 

17.68 

16  89 

16  n 

1  .  )h 

3.75 

I  y 

.  ify 

2.<^6 

6.67 

.78 

1  ,77 

1.96 

.'^0 

94 

2 . 2  i 

'..21 

1.91 

3.08 

2. HI 

f, 

07 

2.  U 

4.2'? 

.8  » 

2.65 

4  . 

1 

07 

!9.84 

}i  86 

16  2  3 

I').  2'. 

n 

8^ .  5ij 

Id  82 

'i6  2ii 

2H.  V 

'>3 

40 

H  .01 

21 .90 

10.55 

8.  J5 

9 

96 
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Table  R- i 

U^XM^}^  SW)N^0R  «FANS  A\D  standard  DF^'lATIOSS  OS  32  F^O  VA^lABLFS 


Supbgr     _  J]^  "^^"^c  ' 

3^23      Adult  to  child,  verbal 
l'*^*      "hlld  to  adult,  all  verbal  ex- 
cept response 
350j     Child  questions  to  adi.Us 
3oOa      Lhlld  responses,  atadenh- 
!63a     (tjild  group  responses  co  adult 
avJtJ«'olt  ^ocsaands.  requests^ 
or  dircoc  questions 
*65a     Adult  responses  to  child  re- 
quests or  questions,  non- 
acadesU 

r.U     (hlld  presenting  Infornatlcn 
tv.  «  group 

Adult  in'.trot  tluT.  non- 
J^admK 

J7^a      Adult  ln»truc  M.>fi,  acadecjlc 
3t<8a      Jhiia  task-related  crrments  to 
adulttf 

390a     Adult  taik-r^lated    crsnent;*  to 
<.hi  Idre.j 

394a     All  ad,'t  acKnowledgnent  to 
chl Idren 

)98a     Ail  adult  praise  to  cMldren 

399a      Adult  relnforv eaent  with 
to<en.  aiadeclc 

■iOSa      All  ddult  corrective  feedback 
to  *  hlldren 

<.12a     Adult  feedback  to  child  re- 
sponties  to  adult  acadealv 
tomandb,  requests,  or 
question^ 

^38a     Adult  -  ocssun  feat  Ion  or  at- 
tcRtloT  focus,  one  thlld 

•«  >**a     Adult  OvjsKunk  at  Ion  or  at- 
tention focus,  two  thlldreT 

^^Oa     Adult  (.ooKunlt  at  Ion  or  at- 
tention focus,  s-aall  group 

-•414     Adult  cosaaunltat  ton  or  at- 
tention fotus.  Urge  group 

•*^'*«     A*lult  Qovenent 

4^2a      \duU  jpcn-ended  questions 
to  ^  hlldren 

•*>••-*      Child's  extended  response  to 
questions 

'*6*a      All  positive  behavior 

4'>3a      All  negative  behavior 

•*^5a      Alult  feedback  to  .hlldren  for 
benavlor 

*^('9.      fhiid  self-*n&rructlon,  aca- 
denl<^ 

>I0^      Child  self-In«trutLlon,  ob- 
jects 

M6v      Social  Interaction  a-iong 

( hi  Idren 
346..      Child  waiting 

Child  -ove-^*»nt 
S87-      All  .>^I1J  task-relattfd  .  o*- 

neTt « 


nlvt-r^I  tv 
Of  Arizona 


 jponaor 

university 


Cnlversltv 


"ean"" 

Heajf^ 

S  -J)/ 

Me_a_n__ 

Mean 

S.D. 

Mean" 

Sj51 

11  OKSuy^ 

Mean  S.D 

Me^n  " 

n.40 

5.4i 

31.  39 

4.11 

33.50 

6.66 

31.47 

4.13 

30.  )7 

2.44 

28.85 

5 

.7} 

28. 18 

■* .  57 

1 .60 

3 . 60 

1.82 

1.71 

.91 

,86 

2  33 

1 .  38 

4.46 

2 

.87 

3.02 

2.49 

1.10 

1.42 

^87 

1 . 31 

.85 

.51 

.52 

1.23 

.84 

1  .47 

.75 

1.44 

6-49 

2.61 

6 . 80 

2  98 

8 .94 

4.14 

I  2  38 

3. 10 

12.32 

2.45 

7.52 

2 

45 

6  68 

86 

.74 

.84 

.61 

1.42 

.94 

6.5h 

2  46 

1.08 

1.02 

1.68 

I 

26 

.80 

.97 

.72 

.69 

.46 

.  54 

43 

.36 

.24 

.21 

.70 

s9 

.58 

19 

4» 

.48 

:.o5 

.  21 

.83 

06 

.15 

15 

.31 

.17 

37 

.04 

3.00 

5  79 

5  80 

3.96 

3.11 

2.25 

1 .84 

2  29 

2.05 

2.05 

2 

21 

3.88 

6.8: 

3  05 

5  U 

},07 

t).31 

3.73 

4.98 

3.37 

5.77 

2.<i6 

6.12 

3 

60 

4.4^ 

1  42 

.86 

1.30 

.97 

1.15 

1.02 

.27 

.93 

.  59 

1.87 

1 

41 

1.35 

1.77 

1 .68 

2.21 

2.51 

1.60 

1.31 

.37 

.32 

.92 

.53 

99 

90 

2.72 

2.51 

1.77 

2  U 

1.30 

3.97 

2.42 

3.49 

2.04 

2  70 

1.17 

3.11 

1 

81 

2.45 

1  .2< 

72 

.95 

.5C 

.83 

.4  J 

2.60 

2.2} 

5.57 

1.77 

.95 

69 

.73 

.01 

.02 

.00 

.01 

.00 

.00 

.25 

.54 

K77 

1.74 

.02 

08 

.00 

4.01 

1.67 

3.43 

2.21 

3.94 

1.61 

3.55 

1.74 

4.95 

2.72 

3.0' 

1 . 

09 

4,34 

5.21 

1.4' 
1  01 


.59 
.11 


63 

2.^6 

1  18 
.  38 

.00 


1.7''- 

1.28 

I.ii4 

.73 

3.  34 

2.  '5 

-  75 

2.57 

4.89 

1.28 

.36 

1 

.44 

1  .84 

1.05 

25. '.^ 

3.19 

2}. 08 

5  46 

26.  ^#9 

5.77 

13.51 

4.49 

28.46 

6.06 

23 

.60 

5 

.80 

23.91 

6.60 

.  70 

.60 

.92 

1.36 

.47 

.52 

.37 

.91 

.19 

.31 

,41 

.  71 

.67 

.64 

4  31 

3  62 

9.97 

6.88 

6.59 

3.58 

16. 3<) 

6.  13 

7.23 

4.49 

9.28 

5 

.72 

3.80 

2. 19 

10.73 

4.^3 

10.69 

6.3« 

10.90 

4.  32 

11.28 

8.93 

6.99 

5.74 

5 

.83 

4 

.86 

10.03 

7.02 

2.  U 

1.45 

2.75 

1  69 

1.67 

.92 

2.73 

2.09 

2.72 

2.56 

2 

22 

55 

2.20 

1.37 

.52 

.48 

6} 

.52 

41 

-12 

,14 

.17 

.16 

32 

28 

.37 

.41 

39 

.27 

.94 

.71 

.30 

.32 

.39 

.44 

.61 

.74 

34 

31 

.3^ 

.32 

1 .44 

90 

.87 

.94 

1.93 

i.89 

.95 

1 .41 

.85 

.45 

1 

06 

.94 

1.5 

1  44 

.2^ 

.63 

.14 

15 

.07 

.11 

.10 

.21 

.07 

.07 

15 

15 

.32 

.28 

1  51 

79 

1.19 

1.03 

.89 

.51 

l.K' 

.62 

.08 

.86 

1 

09 

69 

1 .59 

.80 

10.67 

9.7^ 

11  30 

7.90 

14,16 

5.77 

r.3o 

8.00 

24.47 

6,98 

14 

04 

6 

88 

i:  .53 

5.72 

4.06 

4.75 

5.16 

4.60 

3.99 

1.33 

1  20 

3.42 

8. 

76 

5. 

94 

2.46 

3.64 

4.  18 

2.98 

2.83 

2  39 

I  69 

1.51 

2.n 

1.77 

1  46 

1.28 

3. 

)4 

2. 

84 

2.  59 

1,74 

1  .68 

.73 

.46 

1  36 

l.OS 

2  84 

J.88 

2. 

39 

2. 

77 

1  .34 

2.04 

2.85 

1.21 

2.79 

1.8^> 

2.63 

1.70 

1.88 

1.6C 

.98 

1  0.^ 

1. 

84 

1. 

71 

2.79 

1 .98 

3.H3 

2  Oi 

3  73 

4.34 

3.  n 

1,  H 

2.05 

1.71 

1  41 

3. 

9f, 

2. 

87 

'..73 

2.86 
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THIRD  i.K\'i-  srONSuR  m^asS  AND  STANDARD  OFVlATlON'S  ON  32  P^O  VARIABLES 


    .S££il'*JiL  _  

Inii^crsltv  L'nlveruicv  I'nlvvrsUv 

"N4Pc   "        '  Mi'an     S  I>,    MearT"  STb.    Mean  """sroT    hean"  b .  O".    Mean'     STd     Mean"' S.d".    ^Van  'T.l>. 


Adulc  to  i.hi  Id  V'rbal 

3  •  82 

29 

98 

7 

JO 

4  .07 

32 

38 

7  .02 

^6  84 

4 . 59 

3  '9 

28,5  < 

)*  3a 

2  09 

01 

Jl 

? 

1  73 

76 

5  4"* 

330a 

84 

6'' 

.8  / 

6'« 

.  78 

1.19 

.  49 

1 .90 

1  ' 

1 . 

(hllJ  .espO'Mvs^  acadenit^ 

h.i: 

2.89 

6 

32 

3 

37 

98 

2.94 

12 

46 

4.67 

10.79 

3.19 

7  63 

2  39 

7.3"^ 

J. 

it  ia 

g^<.>vip  re!<pon«>e*  to  adult 
ac  adealt  «.u5saan  s>  request?}. 

or  u  1  r c  Qu^sfvlorts 

90 

I  .05 

92 

) .  6  3 

.  8  3 

,99 

,88 

.96 

1 

365a 

Adult  rospons*?s  to 
^licsts  ot  ^ vic^ s C ion«* ^  non** 

90 

.  29 

.  -^O 

.  34 

.  '6 

95 

Ja 

18 

0 ) 

.07 

.08 

.  27 

.09 

.  24 

,  09 

)/"  ^a 

83 

3 . 30 

1 

2  3 

1 .  •<9 

1 .  f4 

1 .  •<  3 

2 .67 

1 ,65 

2.  J/ 

AMUit.  t HHC rue t.  i^^rt »  ^icdut^^bti. 

5 .88 

T  1' 

69 

66 

51 

4.20 

19 

7 . 50 

4.27 

1  . 95 

6  40 

2 . 32 

5  3 

5s8a 

I .  '>  I 

86 

71 

63 

1 .05 

66 

.  50 

.  35 

.  35 

1 . 22 

1 89 

1  29 

1 

A'^it  V a siic~ 1  a t t^ul  v.tinr*"€nts  to 

1.11 

. 

* 

04 

23 

I 

45 

1 .05 

1 .00 

.8  3 

> 

h  i Idren 

> 

'Iq 

9' 

80 

1 .84 

80 

1  .  35 

3  9  3 

2 . 02 

3 .00 

1 ,62 

1  3  • 

i9>i<i 

All  'lJult  prai'*f  tu  htldr<fn 

HO 

66 

62 

.  34 

1 

96 

1  . 69 

?  95 

1 . 66 

.  80 

,  91 

\d  ilt  rclriroTv  orf'tfjt  with" 

t  •fi*.n,  a^adtnlt 

* 

0. 

00 

02 

00 

.  00 

.04 

1 . 54 

1 . 99 

.01 

,01 

.  00 

•♦J3a 

^11   idiilt  (.crrectlvu  feedbai..it 

t*^  ^hildr^n 

1  3h 

- 

79 

"** 

* 

7  2 

1 . 80 

5 . 09 

1  •  64 

4.57 

1,78 

4  38 

1 . 

Ad^l  I  *    f  ^<^d        K   to  i-Hlld  fC"" 

sp^n**!?^  to  cidiilt  avadc^ic 
<>p**%jnj5>^  rc^utfsts,  or 

^i^t^vt  Ion** 

. 

I 

07 

61 

1 

■«9 

1  19 

3 

59 

1 . 54 

4.57 

2  80 

2 . 52 

1.65 

1  . 

Ad'^lt  i  <  C7un ii  at  ion  or  at- 

tention locus,  one  thild 

'3  lU 

20 

92 

5 

57 

22 

49 

4 . 88 

14 

14 

6  28 

29.  53 

4.  01 

28.42 

5.24 

2f>.  0  \ 

7 . 

39 

Adult  t  onnunKat Ion  or  at- 

.  77 

4l 

53 

56 

.  68 

I  31 

49 

94 

JO 

Adult  t  orraunlcat  ion  or  at- 

tention totus.  snail  group 

}  30 

?.8S 

38 

3 

90 

7 

50 

'..85 

10 

89 

7  67 

4.12 

J  49 

5.51 

4,7^ 

3.75 

3. 

■^•«Ia 

Adult  t.  omunlcat  1      or  at- 

r«^ntl.^tl  foius,  large  group 

9.9J 

9 

90 

6 

n 

12 

94 

5.39 

16 

15 

9.15 

7  89 

6.24 

t)  40 

4,  34 

0.91 

6. 

Adult  noVf  fnt 

^  15 

]  18 

34 

1 

52 

37 

1. 30 

3 

01 

3.07 

4.02 

2.33 

2.0. 

1.76 

2.n 

1. 

^'*»a 

Adult  open-vnded  questions 

to  (children 

f.O 

37 

66 

61 

45 

29 

15 

.  !7 

.27 

.27 

.59 

,47 

.  1^  J 

(SildN  extended  resp(,^nst  tt> 

quest  1  :>«s 

f>  i 

3  J 

5^ 

52 

46 

.31 

34 

35 

.43 

.49 

.23 

.27 

.59 

^62a 

All  pOHltl/e  befavl^ 

i.ii 

i  04 

1 

J4 

2 

26 

1 

13 

95 

62 

.62 

.40 

.27 

.95 

,83 

1  41 

1. 

^6)a 

All  negative  Seravlor 

.  I  > 

,  If> 

13 

17 

28 

.33 

37 

40 

20 

43 

.40 

3^ 

Adult  feedSa.  k  to    hlKjren  f  jr 

behavior 

1  OS 

S  i 

j<> 

96 

. ;  3 

46 

.90 

.88 

1 .54 

1,56 

J.U 

2.01 

1  . 

So'* 

(hlld  sf  U- InstruL  tlon.  av 

de,-i 

9  i6 

10 

8 

39 

14 

13  >.6 

17 

0? 

6.23 

24.65 

9.48 

13.75 

6.02 

15.37 

7 

J 

lMII  seJ  f -In'^trjL  t  ion.  ob- 

}ev  t^ 

6.89 

1 

93 

3 

39 

3 

58 

)  86 

75 

6  44 

1-62 

5.65 

6,92 

i,  10 

S^tlal  literal  tion  j'^t.-nj^ 

<  hi  'dren 

.! .  7v 

1.S6 

) 

31 

J 

55 

3,40 

f.9 

1  80 

1  82 

1  n 

;  00 

3  47 

>.  n 

J. 

(  nl  jd  '-ait  injj 

9h 

51 

53 

J  15 

49 

.95 

2.91 

3.  n 

.s9 

1 ,29 

70 

1 

f"hl'.J  •^ove'-'.ent 

3  2^ 

2.n 

40 

1 

61 

2 

10 

1  81 

1 

1 1 

96 

95 

.94 

2.89 

2  26 

2  66 

1. 

All  .  hi  i  J  f  <s<-r«'lat«  'i  >  - 

t  n  f  s 

2 

3 

09 

91 

o; 

3,  3.» 

63 

:  «8 

I.  -1 

2  0.- 

3,  J7 

2  57 

2.5'. 

.68 

,  26 
,  JO 
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Appendix  S 

COOPERSMITH  AND  INTELLECTUAL  ACHIEVEMENT  RESPONSIBILITY  SCALE  (lAR) 
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THIS  BOOKLET  BELONGS  TO: 


SRI  Adaptation  of  the 
COOPERSMITH  SELF  ESTEEM  INVENTORY 
Time-     15-20  minutes 


MATERIALS: 

Coopefsmith  booklet,  scoring  pencil,  and  card  for  each  child 
PROCEDURE: 

Say  each  item  once  and  repeat  if  necessary 

PRACTICE  ITEMS: 

Begin  practice  items  by  saying, 

•  OPEN  YOUR  BOOK  TO  THE  FIRST  PAGE.    IN  THIS  BOOKLET  THERE  ARE  SENTENCES 
THAT  DESCRIBE  HOW  SOMEONE  ,\11GHT  FEEL.    AFTER  EACH  SENTENCE  THERE  ARE 
TWO  ANSWERS.    THE  ANSWER  ON  THE  LEFT  SAYS  "LIKE  ME".   THE  ANSWER  ON  THE 
RIGHT  SAYS  "NOT  LIKE  ME". 

•  1  AM  GOING  TO  READ  EACH  SENTENCE  ALOUD,  THEN  YOU  DECIDE  IF  THAT 
SENTENCE  SAYS  SOMETHING  THAT  IS  LIKE  YOU  OR  SOMETHING  THAT  IS  NOT  LIKE 
YOU.    IF  THE  SENTENCE  SAYS  SOMETHING  THAT  IS  LIKE  YOU,  MAKE  AN  X  IN  THE 
SPACE  AFTER  "LIKE  ME".    IF  THE  SENTENCE  SAYS  SOMETHING  THAT  IS  NOT  LIKE 
YOU,  MAKE  AN  X  AFTER  "NOT  LIKE  ME". 

•  HERE  IS  AN  EXAMPLE.   LOOK  AT  THE  FIRST  SENTENCE,  SENTENCE  A,  IN  YOUR 
BOOKLET  AND  PL,  CE  YOUR  CARD  UNDER  IT.    I  WILL  READ  IT  TO  YOU.    "I  LIKE  TO 
WATCH  T.V."    IF  THAT  SENTENCE  DESCRIBES  HOW  YOU  USUALLY  FEEL,  MAKE  AN  X 
AFTER  "LIKE  ME"  (point  to  the  space  after  "Like  Me").    IF  THAT  SENTENCE  DOES  NOT 
DESCRIBE  HOW  YOU  USUALLY  FEEL,  MAKE  AN  X  AFTER  "NOT  LIKE  ME"  (point  to  the 
space  after  "Not  Like  Me"). 

•  LET'S  TRY  ANOTHER  ONE.  MOVE  YOUR  CARD  DOWN  TO  SENTENCE  B  IN  YOUR 
BOOKLET.  I  WILL  READ  IT  TO  YOU.  "I'M  A  GOOD  WORKER".  DECIDE  IF  THAT 
SENTENCE  IS  LIKE  YOU  OR  NOT  LIKE  YOU  AND  PUT  AN  X  AFTER  YOUR  ANSWER. 

•  ARE  THERE  ANY  QUESTIONS  ABOUT  WHAT  YOU  ARE  TO  DO?    (Answer  any  questions) 

•  I  WILL  READ  EACH  STATEMENT  TO  YOU,  THEN  YOU  MAKE  AN  X  AFTER  THE 
ANSWER  THAT  YOU  CHOOSE.    USE  YOUR  CARD  TO  FOLLOW  ALONG  WITH  EACH 
STATEMENT  THAT  I  READ  TO  YOU. 

•  LET'S  START.    REMEMBER,  THERE  ARE  NO  RIGHT  OR  WRONG  ANSWERS. 


er|c-2 


BEGIN  TEST: 

Throughout  the  test  each  item  should  be  said  once  but,  any  item  may  be  repeated  if  it  becomes 
necessary.  Always  s^y  the  item  number.  The  children  may  also  be  reminded  to  mark  their  choice 
of  "Like  Me"  cr  "Not  Like  Me", 


•  NUMBER  1 

•  NUMBER  2 

•  NUMBER  3 

•  NUMBER  4 

•  NUMBER  5 

•  NUMBER  6 

•  NUMBER  7 

•  NUMBER  8 

•  NUMBER  9 

•  NUMBER  10 

•  NUMBER  11 

•  NUMBER  12 

•  NUMBER  13 

•  NUMBER  14 

•  NUMBER  15 

•  NUMBER  16 

•  NUMBER  17 

•  NUMBER  18 

•  NUMBER  19 

•  NUMBER  20 

•  NUMBER  21 
e  NUMBER  22 

•  NUMBER  23 
©  NUMBER  24 

•  NUMBER  25 

•  NUMBER  26 

•  NUMBER  27 

•  NUMBER  28 

•  NUMBER  29 
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"I  SPEND  A  LOT  OF  TIME  DAYDREAMING." 
"I'M  PRETTY  SURE  OF  MYSELF." 
"I  OFTEN  WISH  I  WERE  SOMEONE  ELSE." 
"I'M  EASYTO  LIKE." 

"MY  PARENTS  AND  I  HAVE  A  LOT  OF  FUN  TOGETHER." 
"I  NEVER  WORRY  ABOUT  ANYTHING." 

"I  FIND  IT  VERY  HARD  TO  TALK  IN  FRONT  OF  THE  CLASS." 
"I  WISH  I  WERE  YOUNGER." 

"THERE  ARE  LOTS  OF  THINGS  ABOUT  MYSELF  I'D  CHANGE  IF  I  COULD. 

"I  CAN  MAKE  UP  MY  MIND  WITHOUT  TOO  MUCH  TROUBLE." 

"I'M  A  LOT  OF  FUN  TO  BE  WITH." 

"I  GET  UPSET  EASILY  AT  HOME." 

"I  ALWAYS  DO  THE  RIGHT  THING." 

"I'M  PROUD  OF  MY  SCHOOL  WORK." 

"SOMEONE  ALWAYS  HAS  TO  TELL  ME  WHAT  TO  DO." 

"IT  TAKES  ME  A  LONG  TIME  TO  GET  USED  TO  ANYTHING  NEW." 

"I'M  OFTEN  SORRY  FOR  THE  THINGS  I  DO" 

"I'M  POPULAR  WITH  KIDS  MY  OWN  AGE." 

"MY  PARENTS  USUALLY  CONSIDER  MY  FEELINGS." 

"I'M  NEVER  UNHAPPY." 

"I'M  DOING  THE  BEST  WORK  THAT  I  CAN." 

"I  GIVE  IN  VERY  EASILY." 

"I  CAN  USUALLY  TAKE  CARE  OF  MYSELF." 

"I'M  PRETTY  HAPPY." 

"I  WOULD  RATHER  PLAY  WITH  CHILDREN  YOUNGER  THAN  ME." 

"MY  PARENTS  EXPECT  TOO  MUCH  OF  ME." 

"I  LIKE  EVERYONE  I  KNOW." 

"I  LIKE  TO  BE  CALLED  ON  IN  CLASS." 

"I  UNDERSTAND  MYSELF." 
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•  NUMBER  30  "IT'S  PRETTY  TOUGH  TO  BE  ME." 

•  NUMBER  31  "THINGS  ARE  ALL  MIXED  UP  IN  MY  LIFE." 

•  NUMBER  32  "KIDS  USUALLY  FOLLOW  MY  IDEAS." 

•  NUMBER  33  "NO  ONE  PAYS  MUCH  ATTENTION  TO  ME  AT  HOME." 

•  NUMBER  34  "I  NEVER  GET  SCOLDED." 

•  NUMBER  35  "I'M  NOT  DOING  AS  WE  LL  IN  SCHOOL  AS  I'D  LIKE  TO." 

•  NUMBER  36  "I  CAN  MAKE  UP  MY  MIND  AND  STICK  TO  IT." 

•  NUMBER  37  FIRST  I  WILL  READ  THIS  STATEMENT  FOR  THE  GIRLS 

—LISTEN  GIRLS.  "1  REALLY  DON'T  LIKE  BEING  A  GIRL." 
NOW  BOYS  I  WILL  READ  THIS  STATEMENT  FOR  THE  BOYS 
—LISTEN  BOYS.    "I  REALLY  DON'T  LIKE  BEING  A  BOY." 

•  TURN  THE  PAGE. 

•  NUMBER  38  "I  HAVE  A  LOW  OPINION  OF  MYSELF." 

•  NUMBER  39  "I  DON'T  LIKE  TO  BE  WITH  OTHER  PEOPLE."  ' 

•  NUMBER  40  "THERE  ARE  MAN Y  TIMES  WHEN  I'D  LIKE  TO  LEAVE  HOME." 
»  NUMBER  41  "I'M  NEVER  SHY." 

•  NUMBER  42  "I  OFTEN  FEEL  UPSET  IN  SCHOOL." 

•  NUMBER  43  "I  OFTEN  FEEL  ASHAMED  OF  MYSELF." 

•  NUMBER  44  "I'M  NOT  AS  NICE  LOOKING  AS  MOST  PEOPLE." 

•  NUMBER  45  "IF  I  HAVE  SOMETHING  TO  SAY,  I  USUALLY  SAY  IT." 

•  NUMBER  46  "KHS  PICK  ON  ME  VERY  OFTEN." 

•  NUMBER  47  "MY  PARENTS  UNDERSTAND  ME." 

•  NUMBER  48  "I  ALWAYS  TELL  THE  TRUTH." 

•  NUMBER  49  "MY  TEACHER  MAKES  ME  FEE L  THAT  I'M  NOT  GOOD  ENOUGH." 

•  NUMBER  50  "I  DON'T  CARE  WHAT  HAPPENS  TO  ME." 

•  NUMBER  51  "I'M  A  FAILURE." 

•  NUMBER  52  "I  GET  UPSET  EASI  LY  WHEN  I'M  SCOLDED." 

•  NUMBER  53  "MOST  PEOPLE  ARE  BETTER  LIKED  THAN  I  AM." 

•  NUMBER  54  "I  USUALLY  FEEL  AS  I F  MY  PARENTS  ARE  PUSHING  ME." 

•  NUMBER  55  "I  ALWAYS  KNOW  WHAT  TO  SAY  TO  PEOPLE." 

•  NUMBER  56  "I  OFTEN  GET  DISCOURAGED  IN  SCHOOL." 

•  NUMBER  57  "THINGS  USUALLY  DON'T  BOTHER  ME." 

•  NUMBER  58  "I  CAN'T  BE  DEPENDED  ON."  ^."JiJ 
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Group  Test 


THIS  BOOKLET  BELONGS  TO: 


SRI  Adaptation  of  the 
INTELLECTUAL  ACHIEVEMENT  RESPONSIBILITY  SCALE 


INSTRUCTIONS  AND  PROCEDURE 
MATERIALS:     lAR  Booklet  and  scoring  pencil  for  each  child 
PROCEDURE:     Each  item  should  be  said  twice 
BEGIN  TEST:     Introduce  the  test  by  saying: 

•  YOU  SHOULD  EACH  HAVE  A  BOOKLET. 

•  THIS  BOOKLET  HAS  SENTENCES  WHICH  TELL  ABOUT  LOTS  OF  THINGS  THAT 
HAPPEN  TO  MANY  OF  YOU  EVERY  DAY.    NOW,  OPEN  YOUR  BOOKLET,  BUT 

DO  NOT  MARK  ANYTHING  UNTIL  I  TELL  YOU.     I  WILL  READ  THE  FIRST  PART 
OF  THE  SENTENCE.    THEN  I  WILL  READ  TWO  DIFFERENT  ENDINGS  FOR  THE 
SENTENCE.    IN  YOUR  BOOKLET  THESE  ENDINGS  ARE  MARKED  "a"  AND  "B". 
(Demonstrate)    CHOOSE  THE  ONE  ENDiNG  THAT  TELLS  HOW  YOU  USUALLY 
THINK  OR  FEEL.    PUT  AN  X  ON  THE  LETTER  "A"  IF  THAT  ENDING  FITS 
YOU  BEST.    PUT  AN  X  ON  THE  LETTER  "B"  IF  THAT  ENDING  FITS  YOU  BEST. 
THERE  ARE  NO  RIGHT  OR  WRONG  ANSWERS;  JUST  ANSWER  EACH  QUESTION 
THE  WAY  YOU  REALLY  FEEL 

»  I  WILL  READ  THE  FIRST  PART  OF  THE  SENTENCE  AND  EACH  OF  THE  ENDINGS 
TWO  TIMES.     LISTEN  CAREFULLY  AND  PUT  AN  X  ON  "A"  OR  "B"  TO  SHOW 
HOW  YOU  USUALLY  FEEL.    DO  NOT  MARK  ANYTHING  UNTIL  I  TELL  YOU. 


«  THE  FIRST  SENTENCE  IS  "IF  A  TEACHER  PASSES  YOU  TO  THE  NEXT  GRADE, 
IT  IS  BECAUSE 

[a]    she  LIKED  YOU." 

ID    YOU  DID  GOOD  WORK." 

•  I'LL  READ  IT  ONCE  MORE.  "IF  A  TEACHER  PASSES  YOU  TO  THE  NEXT  GRADE, 
IT  IS  BECAUSE 

[a]    she  LIKED  YOU." 


B     YOU  DID  GOOD  WORK." 


«  NOW,  PLEASE  PUT  AN  X  ON  "A"  OR  "B" 


«  EVERYONE  WILL  DO  HIS  OWN  WORK.  PLEASE  DO  NOT  TALK. 


•  now  look  at  number  2.  the  sentence  is,  "when  you  do  well  on  a  school 
test,  it  is  because 

[a]  you  work  hard." 

d]   the  test  is  very  easy." 

•  i'll  read  it  once  more.  "when  you  do  well  on  a  school  test,  it  is 

BECAUSE 
(a]    you  work  HARD." 
dj     THE  TEST  IS  VERY  EASY." 

•  now,  please  put  an  X  ON  "A"  OR  "B" 

Continue    'ith  the  test  and  remember  to  say  each  item  twice 

•  NUMBER  3.  THE  SENTENCE  IS,  "WHEN  YOUR  SCHOOL  WORK  IS 
VERY  HARD  TO  UNDERSTAND,  IT  IS  BECAUSE 

(a)    the  teacher  ISN'T  GIVING  YOU  ENOUGH  HELP." 

(U     YOU  AREN'T  LISTENING  TO  WHAT  SHE  SAYS." 

Repeat  the  item.    Throughout  the  test  check  to  be  certain  that  the  children  are  marking 
either  an  "A"  or  "B".    If  at  anytime  they  are  not  marking  correctly,  repeat  the 
instruct'cr.. 

•  PLACE  AN  X  ON  "A"  OR  "B" 

Fduse 

•  NUMBER  4.  THE  SENTENCE  IS,  "WHEN  YOU  CAN'T  REMEMBER  MUCH  OF  A  STORY 
YOU  READ,  IT  IS  BECAUSE 

[a]    the  story  ISN'T  ANY  good." 

(U    THE  STORY  ISN'T  ABOUT  SOMETHING  YOU  LIKE." 

Repeat  the  item. 
Pause 
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•  NUMBER  5.  THE  SENTENCE  IS,  "IF  YOUR  MOTHER  SAYS  YOU  ARE  DOING  WELL 
IN  SCHOOL,  IT  IS  BECAUSE 

fA]    YOUR  SCHOOL  WORK  IS  GOOD." 


B      YOUR  MOTHER  IS  FEELING  WELL." 


Repeat  the  item. 
Pause 

•  NUMBER  6.  THE  SENTENCE  IS,  "IF  YOU  DO  BETTER  THAN  USUAL  IN  SOMETHING 
AT  SCHOOL,  IT  IS  BECAUSE 

(a]     you  WORK  harder." 


B     SOMEONE  HELPS  YOU." 


Repeat  the  item. 
Pause 

9  Number  i.  the  sentence  is,  "when  you  lose  at  a  game  of  cards  or  checkers, 

IT  IS  because 


AJ    THE  OTHER  PLAYER  IS  GOOD  AT  THE  GAME." 
[B]     you  DON'T  PLAY  well." 

Repeat  the  item. 
Pause 

•  NUMBER  8.  THE  SENTENCE  IS,  "SUPPOSE  A  PERSON  DOESN'T  THINK  YOU  DO  GOOD 
WORK. 

[a]    you  CAN  MAKE  HIM  CHANGE  HIS  MIND  IF  YOU  TRY  TO." 

ID     SOME  PEOPLE  WILL  THINK  YOU  DON'T  DO  GOOD  WORK 
NO  MATTER  WHAT  YOU  DO." 

Repeat  the  item. 
Pause 
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•  NUMBER  9.  THE  SENTENCE  IS,  "IF  YOU  FINISH  A  PUZZLE  REAL  FAST,  IT  IS 
BECAUSE 


A     THE  PUZZLE  ISN'T  VERY  HARD." 


[D     YOU  WORK  CAREFULLY  ON  THE  PUZZLE." 


Repeat  the  item. 
Pause 


•  NUMBER  10.  THE  SENTENCE  IS,  "IF  SOMEONE  TELLS  YOU  THAT  YOU 
ARE  DUMB,  IT  IS  BECAUSE 


A     HE  IS  MAD  AT  YOU." 


[D    WHAT  YOU  DID  REALLY  WASN'T  VERY  BRIGHT." 


Repeat  the  item. 
Pause 


«  NUMBER  11.  THE  SENTENCE  IS,  "I F  YOU  WANTED  TO  BECOME  A  TEACHER, 
SCIENTIST,  OR  DOCTOR  AND  DIDN'T  MAKE  IT,  IT  WOULD  BE  BECAUSE 

(a)  YOU  didn'twork  hard  enough." 


8     OTHER  PEOPLE  SHOULD  HAVE  HELPED  YOU  MORE." 


Repeat  the  item. 
Pause 


•  NUMBER  12.  THE  SENTENCE  IS,  "IF  SOMETHING  IS  EASY  TO  LEARN  AT  SCHOOL, 
IT  IS  BECAUSE 

[A]     YOU  PAY  ATTENTION." 

[U    THE  TEACHER  GIVES  YOU  LOTS  OF  HELP." 


Repeat  the  item. 
Pause 


•  NUMBER  13.  THE  SENTENCE  IS,  "IF  A  TEACHER  SAYS  TO  YOU,  'YOUR 
WORK  IS  FINE',  IT  IS  BECAUSE 

(A)    TEACHERS  USUALLY  SAV  THAT  TO  ENCOURAGE  PUPILS." 

lU    YOU  DID  A  GOOD  JOB." 

Repeat  the  item 
Pause 

•  TURN  THE  PAGE 

•  NUMBER  14.  THE  SENTENCE  IS,  "WHEN  ARITHMETIC  OR  NUMBER  PROBLEMS  ARE 
HARD  TO  WORK  AT  SCHOOL,  IT  IS  BECAUSE 

(a]    you  DON'T  DO  ENOUGH  WORK  ON  THE  PROBLEMS." 

d]    THE  PROBLEMS  ARE  TOO  HARD." 

Repeat  the  item 
Pause 

•  NUMBER  15.  THE  SENTENCE  IS,  "IF  YOU  FORGET  SOMETHING  THE  TEACHER  SAYS 
IN  CLASS,  IT  IS  BECAUSE 

[a]  the  teacher  DOESN'T  SAY  IT  VERY  WELL." 

[b]  you  DON'T  TRY  VERY  HARD  TO  REMEMBER." 

Repeat  the  item 
Pauae 

•  NUMBER  16.  THESENTENCEIS,"IFYOUWEREN'TSUREABOUTTHE  ANSWER 

TO  A  QUESTION  THAT  YOUR  TEACHER  ASKED  YOU,  BUT  YOUR  ANSWER  TURNED 
OUTTO  BE  RIGHT,  IT  WOULD  HAPPEN  BECAUSE 

[a]    THE  TEACHER  WASN'T  AS  PARTICULAR  AS  USUAL." 

^R}    YOU  GAVE  THE  BEST  ANSWER  YOU  COULD  THINK  OF." 

Repeat  the  Item 
Pause 


•  NUMBER  17.  THE  SENTENCE  IS,  "IF  YOU  REMEMBER  MOST  OF  A  STORY  YOU  READ, 
IT  IS  BECAUSE 

(a)    THE  STORY  IS  ABOUT  SOMETHING  YOU  LIKE." 

d]    THE  STORY  IS  GOOD." 

Repeat  the  item 
Pause 


•  NUMBER  18.  THE  SENTENCE  IS,  "IF  YOUR  MOTHER  SAYS  YOU'RE  ACTING  SILLY, 


A)     IT  IS  BECAUSE  OF  SOMETHING  YOU  DID." 
lU     IT  IS  BECAUSE  SHE  IS  NOT  FEELING  GOOD.' 

Repeat  the  item 
Pause 


•  NUMBER  19.  THE  SENTENCE  IS,  "WHEN  YOU  DO  NOT  DO  WELL  ON  A  SCHOOL 
TEST,  IT  IS  BECAUSE 
fAl    THE  TEST  IS  VERY  HARD." 


B     YOU  DON'T  DO  YOU  WORK.' 


Repeat  the  item 
Pause 


NUMBEh  ^0.  THE  SENTENCE  IS,  "WHEN  YOU  WIN  AT  A  GAME  OF  CARDS 
OR  CHECKERS,  IT  IS  BECAUSE 

iAl     YOU  PLAY  REALWELL." 


B      THE  OTHER  PERSON  DOESN'T  PLAY  WELL." 


Repeat  the  item 
Pause 
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NUMBER  21.  THE  SENTENCE  !S,  "IF  PEOPLE  THINK  YOU  DO  GOOD  WORK  IT  IS 
BECAUSE 

[a]    THEY  like  you." 

d]    YOU  DO  THINGS  WELL." 

Repeat  the  item 
Pause 

NUMBER  22.  THE  SENTENCE  IS,  "IF  THE  TEACHER  DIDN'T  PASS  YOU 
TO  THE  NEXT  GRADE,  IT  WOULD  HAPPEN  BECAUSE 

[a]  she  HAD  IT  IN  FOR  YOU." 

[H    YOUR  SCHOOL  WORK  WASN'T  GOOD  ENOUGH." 

Repeat  the  item 
Pause 

NUMBER  23.  THE  SENTENCE  IS,  "IF  YOU  DON'T  DO  AS  WELL  AS  USUAL  IN 
SOMETHING  AT  SCHOOL,  IT  WOULD  HAPPEN  BECAUSE 

0    YOU  DON'T  DO  YOUR  WORK." 

[b]  someone  BOTHERS  you." 

Repeat  the  item 
Pause 

« 

NUMBER  24.  THE  SENTENCE  IS,  "IF  A  BOY  OR  GIRL  SAYS  THAT  YOU  DO  GOOD  WORK, 
IT  IS  BECAUSE 

(A|    YOU  DO  THINGS  WELL." 

(U    THEY  LIKE  YOU." 

Repeat  the  item 
Pause 


•  NUMBER  25.  THE  SENTENCE  IS,  "IF  YOU  BECAME  A  FAMOUS  TEACHER, 
SCIENTIST  OR  DOCTOR,  IT  WOULD  HAPPEN  BECAUSE 

(a]    OTHER  PEOPLE  HELPED  YOU  WHEN  YOU  NEEDED  IT." 

\Bj    YOU  WORKED  VERY  HARD." 

Repeat  the  item 
Pause 

•  NUMBER  26.  THE  SENTENCE  IS,  "IF  YOUR  MOTHER  SAYS  YOU'RE  NOT  DOING 
WELL  IN  YOUR  SCHOOL  WORK,  IT  IS  BECAUSE 

(a)    your  SCHOOL  work  ISN'T  good." 

YOUR  MOTHER  ISN'T  FEELING  WELL." 

Repeat  the  item 
Pause 

•  TURN  THE  PAGE. 

•  NUMBER  27.  THE  SENTENCE  IS,  "IF  YOU  ARE  SHOWING  A  FRIEND  HOW 
TO  PLAY  A  GAME  AND  HE  HAS  TROUBLE  WITH  IT,  THAT  WOULD  HAPPEN 
BECAUSE 

[a]  HE  WASN'T  ABLE  TO  UNDERSTAND  HOW  TO  PLAY." 
\b}    you  COULDN'T  explain  IT  well." 

Repeat  the  item 
Pause 

•  NUMBER  28.  THE  SENTENCE  IS,  "WHEN  ARITHMETIC  OR  NUMBER  PROBLEMS  ARE 
EASY  TO  WORK  AT  SCHOOL,  IT  IS  BECAUSE 

|A]    THE  PROBLEMS  ARE  EASY." 

[b]  you  work  hard  on  the  PROBLEMS." 

Repeat  the  item 
Pause 
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e  NUMBER  29.  THE  SENTENCE  IS,  "WHEN  YOU  REMEMBER  SOMETHING  THE  TEACHER 
SAYS  IN  CLASS,  IT  IS  BECAUSE 

[A]    YOU  TRY  HARD  TO  REMEMBER." 

l]    THE  TEACHER  SAYS  IT  WELL." 

Repeat  the  item 
Pause 

•  NUMBER  30.  THE  SENTENCE  IS,  "IF  YOU  CAN'T  WORK  A  PUZZLE,  IT  IS 
BECAUSE 

(A]    YOU  ARE  NOT  GOOD  AT  WORKING  PUZZLES." 

1]    THE  INSTRUCTIONS  WEREN'T  WRITTEN  CLEARLY  ENOUGH." 

Repeat  the  item 
Pause 

•  NUMBER  31.  THE  SENTENCE  IS,  "IF  YOUR  MOTHER  TELLS  YOU  THAT  YOU 
ARE  BRIGHT  AND  CLEVER, 

[A]    IT  IS  BECAUSE  SHE  IS  FEELING  GOOD." 

[H     !T  IS  BECAUSE  OF  SOMETHING  VOU  DID." 

Repeat  the  item 
Pause 

•  NUMBER  32.  THE  SENTENCE  IS,  "IF  YOU  ARE  EXPLAINING  HOW  TO  PLAY  ' 
A  GAME  TO  A  FRIEND  AND  HE  LEARNS  QUICKLY,  IT  WOULD  HAPPEN 
BECAUSE 

[A]    YOU  EXPLAINED  IT  WELL.' 

1]     HE  WAS  ABLE  TO  UNDERSTAND  IT." 

Repeat  the  item 
Pause 


•  number  33.  the  sentence  is,  "if  you're  not  sure  about  the  answer 
to  a  question  your  teacher  asks  you  and  the  answer  you  give  turns 
out  to  be  wrong,  it  would  happen  because 

(a)  the  teacher  was  more  particular  than  usual." 

\b}  you  answered  too  quickly." 

Repeat  the  item 
Pause 


•  NUMBER  34.  THE  SENTENCE  IS,  "IF  ATEACHER  SAYS  TO  YOU,  TRY  TO  DO  BETTER,' 
IT  IS  BECAUSE 


(A)    SHE  WANTS  YOU  TO  TRY  HARDER." 

(H    YOUR  WORK  ISN'T  AS  GOOD  AS  USUAL." 


CLOSE  YOUR  BOOK. 
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Appendix  T 

CORRELATION  OF  TEACHER  QUESTIONNAIRE  ITEMS  AND  IMPLEMENTATION  SCORE" 
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Table  T-5 


CORRELATION  OF  TEACHERS'  SATISFACTION  WITH  THE  MODEL 
WITH  IMPLEMENTATION  SCORES 
(First  and  Third  Grades  Combined) 


Site 


Far  West  (N=40) 
Mean 
S.D. 
r 

P< 

University  of  Arizona  (N=33) 
Mean 
S.D. 
r 

P< 

Bank  Street  (N=38) 
Mean 
S.D. 
r 

P< 

University  of  Oregon  (N=37) 
Mean 
S.D. 
r 

P< 

University  of  Kansas  (N=34} 
Mean 
S.D. 


High/Scope  (N=40) 
Mean 
S.D. 
r 

P< 

EDC  (N=38) 
Mean 
S.D. 
r 

P< 


Questionnaire  Items  

Would  Continue 

to  Teach  in  "ouid  Change 
Follow  Through      the  Model 


4.23 

1.19 
.04 
.810 

4.12 
1.34 
-.14 
.427 

4.58 
.76 
.17 
.301 

4.41 

.90 
-.13 

.437 

4.22 
1.08 
-.20  * 
.268 

4.68 

.66 
-.22 

.175 

4.63 

.79 
-.17 

.305 


3.35 

.62 
-.17 

.285 

3.16 

.69 
-.18  * 

.323 

3.58 
.64 
.24 
.151 

3.00 

.72 
-.30 

.072 


A* 


3.03 
.67 

-.09 
.622 

3.40 
.55 
.01 
.972 

3.59 
.69 
.10 
.546 


Two  teachers  failed  to  respond  to  this  item. 
One  teacher  failed  to  respond  to  this  item. 
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